HAPPIE: the haptic audio-production pipeline

Paterson, Justin ORCID: https://orcid.org/0000-0001-7822-319X and Visser, Andy (2021) HAPPIE: the haptic audio-production pipeline. In: Conference of New Interfaces for Musical Expression, 1-4 June 2021, Shanghai, China. (Submitted)

Full text not available from this repository. (Request a copy)

Abstract

The ‘Haptic Audio Pipeline for the Production of Immersive Experiences’ (HAPPIE) project is a consortium effort that is developing a new protocol to unify all forms of haptic hardware and relevant software. As part of this, an audio-production pipeline (H-APP) has been developed that employs 6DOF high-resolution multi-point force feedback. Audio is modelled as an abstraction in a virtual environment, that the user can touch and reshape with their hands according to physics modelling properties such as friction, centre of gravity and resistance. The shape is mapped to numerous audio-production parameters via semantic relationships that enable neural-network-driven parameter reduction, and as the user manipulates the shape with their hands, complex and intuitive control of the audio can be exerted. The system operates in mixed reality so that the user can superimpose this mode of interaction upon their natural field of view and continue to operate a conventional hardware or software production setup simultaneously. This paper presents a detailed insight into this project.

Item Type: Conference or Workshop Item (Paper)
Uncontrolled Keywords: haptic, immersive, audio, mixed reality, neural networks
Subjects: Music > Music/audio technology
Music > Record production
Depositing User: Justin Paterson
Date Deposited: 01 Feb 2021 18:43
Last Modified: 28 Aug 2021 07:14
URI: http://repository.uwl.ac.uk/id/eprint/7644

Actions (login required)

View Item View Item

Menu