An Audio-Only Augmented Reality System for Social Interaction



Abstract: Music plays a crucial role in social interactions. This thesis examines how an interactive environment might facilitate such exchanges by developing and evaluating a novel system for joint music consumption by a group of users in the same place and time. The system provides a platform for the creation of spatial interactive music. It uses relative locations measured using a Bluetooth signal, and generates an immersive personalized augmented musical environment that depends on the location of its participants. I conducted two experiments testing the system within the context of a silent disco party, using the system's relative position signals as well as video tracking to evaluate the experience of users with and without prior acquaintance. The results showed that for both groups, the system promoted openness and increased the social interaction between users.

Gurion, Tom. "An Audio-Only Augmented Reality System for Social Interaction." Thesis. Bar-Ilan University Music Department. Ramat Gan Israel, 2015.

Publications

In addition to the thesis I published an extended abstract in the proceedings of HCI International 2013, and presented a poster in the conference posters session:

Gurion, Tom, and Nori Jacoby. "Audio-only augmented reality system for social interaction." HCI International 2013-Posters’ Extended Abstracts. Springer Berlin Heidelberg, 2013. 322-326.

The extended abstract PDF is freely available here.

I also gave an oral presentation of my research at ISTAS'13.

Video demonstration of the Pure Data patch

This demo shows how movement of participants in space affects the music they hear through their own Android device and headphones using the system in a silent disco party. In addition it demonstrate the influence of different participants on one another when one virtual participant takes diverse sound zones with him during this simulation. The music is the same as in the original system.

Participants movement tracking animations from experiment #2

Crucial part of the analysis of experiment #2. More info on the way...