Paterson, Justin ORCID: https://orcid.org/0000-0001-7822-319X and Visser, Andy (2024) Feel the future – Touching Sound. In: UWL TEDx event, 8 March 2024, London, UK.

Full text not available from this repository.

Abstract

It is nearly 100 years since sound was first synchronised to moving visuals in the movie The Jazz Singer, and perceiving the entertainment or information space with audio and video now pervades our daily lives – yet the sense of touch is still largely absent. In daily life, touch alone gives us a constant stream of information about our environment, from the weight of a paper cup as we drink to finding a light switch in the dark – this mode of sensing is called haptics.

Combining haptics with audio and video offers a powerful new form of experience. This TEDx presentation will offer perspectives into how this experience might yet come to be part of our future lives. It will give demonstrations, including real-time haptic/audio collaboration between individuals (empowered by AI) within a virtual space – a world where sound isn’t just heard, but also felt. Welcome to the future of sensory engagement.

The presentation will first offer perspectives into how haptic audio might yet come to be part of our future lives. It will then present research into ongoing development of a novel music-performance environment. In this, an interactive music track is modelled as a flat deformable abstraction in extended reality. Physics modelling and neural networks are utilized to exert control over it and provide both visual and haptic-force feedback on user interaction. Networked computers hosting a hybrid software configuration allow multiple users to engage with this abstraction remotely – using haptic robotic controllers to deliver a collaborative music performance.

The use of haptics appears to offer an enhanced level of control compared to traditional virtual-reality wands, thus facilitating precise performative gestures that may not otherwise be possible. The presentation will include a breakdown of the system architecture required to deliver this, and demonstrate a performance using it.

Item Type:	Conference or Workshop Item (Lecture)
Subjects:	Music
Related URLs:	https://www.youtube.com/watch?v=9af9qgbT...
Depositing User:	Justin Paterson
Date Deposited:	10 Oct 2024 10:08
Last Modified:	10 Oct 2024 10:08
URI:	https://repository.uwl.ac.uk/id/eprint/12764

Actions (login required)

View Item