All tagged augmented reality

Following the Master’s Hands: Capturing Piano Performances for Mixed Reality Piano Learning Applications

Following the Master’s Hands: Capturing Piano Performances for Mixed Reality Piano Learning Applications

Cagri Zaman
Augmented Reality, Conference Talk, Research

ACM Human Factors in Computing System (CHI) 2023.

Piano learning applications in Mixed Reality (MR) are a promising substitute for physical instruction when a piano teacher is absent. Existing piano learning applications that use visual indicators to highlight the notes to be played on the keyboard or employ video projections of a pianist provide minimal guidance on how the learner should execute hand movements to develop their technique in performance and prevent injuries. To address this gap, we developed an immersive first-person piano learning experience that uses a library of targeted visualizations of the teacher’s hands and 3D traces of hand movements in MR.

Virtuality & Presence

Virtuality & Presence

Cagri Zaman
Teaching, Augmented Reality, Virtual Reality

This course aims to help students invent and analyze new forms of extended reality (XR) experiences, computer-based art, gaming, social media, interactive narrative, and related technologies. This semester’s focus is on the theory, design, and implementation of experiences and technologies of virtuality. Toward this end, we shall look at topics including definitions of virtual, virtual reality, augmented reality, alternate reality, hybrid reality, virtual worlds, virtual selves, and more.

Beyond Light - Archeologia Invisibile Exhibition

Beyond Light - Archeologia Invisibile Exhibition

Cagri Zaman
Exhibition, Augmented Reality

Exhibition at the Museo Egizio, Turin, Italy. 2019-2021

The purpose of the “Invisible Archeology” exhibition was to illustrate the principles, tools, examples and results of the meticulous work of recomposition of information, data and knowledge made possible today by the application of science to other disciplines and, in particular, to the study of the artifacts. What can an object tell of itself? Our senses give us basic information about it, such as its appearance, size, shape, colour, even the traces that human, nature or time have impressed on it. Yet, all this is obviously not enough to reveal the whole story and the life cycle.

A Hand-Motion Based Tool for Conceptual Model Making in Architecture

A Hand-Motion Based Tool for Conceptual Model Making in Architecture

Cagri Zaman
Thesis, Augmented Reality, Computational Making, Design

SM Thesis. Istanbul Technical University. 2011

Three-dimensional perception facilitated by physical model making supports the creative process and enhances the designer’s ability to evaluate the formal qualities of their design. In our this thesis, we aim to sustain this support in different design environments and study the transfer of the hand motions used in the physical model making processes and use in the digital design environments. We show the results from the observations taken from the conceptual model making processes and analyze the actions involved in these processes as the first step of the research. Depending on this observations we classify the actions according to the main characteristics of the hand motions and propose a recognition schema to be processed in the digital platform. Following the analysis and the classification of the hand motions used in the model making process we aim on translating these hand motions into the digital platform. We discuss the technologies and methods used for hand motion capturing and recognition, and develop a design environment utilizing the hand motions used in the model making processes. We finalize our approach by presenting a set of algorithms for the object deformations conducted with the hand motions. Finally, we test the design environment and discuss the results.