The use of visual and auditory feedback for assembly task performance in a virtual environment

Zhang, Ying ORCID:, Sotudeh, Reza and Fernando, Terrence (2005) The use of visual and auditory feedback for assembly task performance in a virtual environment. In: The 21st Spring Conference on Computer Graphics, 12-14 May 2005, Budmerice, Slovakia.

Full text not available from this repository. (Request a copy)


This paper presents our creation and evaluation of multi-modal interface for a virtual assembly environment (VAE). It involves implementing an assembly simulation environment with multisensory feedback (visual and auditory), and evaluating the effects of multi-modal feedback on assembly task performance. This virtual environment experimental platform brought together complex technologies such as constraint-based assembly simulation, optical motion tracking technology, and real-time 3D sound generation technology around a virtual reality (VR) workbench and a common software platform. Peg-in-a-hole and Sener electronic box assembly tasks have been used as the task cases to perform human factor experiments, using sixteen subjects. Both objective performance data (task completion time, and human performance error rates) and subjective opinions (questionnaires) have been gathered from these experiments. The results showed that the addition of 3D auditory or visual feedback did introduce an improvement in the virtual assembly task performance. They also indicated that the integrated feedback (visual plus auditory) offered better task performance than any feedback used in isolation. Most of the users preferred the combined feedback to any individual feedback (visual or auditory) or no feedback.

Item Type: Conference or Workshop Item (Paper)
ISBN: 1595932046
Identifier: 10.1145/1090122.1090133
Page Range: pp. 59-66
Identifier: 10.1145/1090122.1090133
Keywords: User-Centered Design, Virtual Environments, Multi-sensory Feedback, Assembly Simulation, Usability, Task Performance
Subjects: Computing > Innovation and user experience > Computing interaction design
Computing > Innovation and user experience > Usability
Related URLs:
Depositing User: Ying Zhang
Date Deposited: 16 Jul 2019 17:40
Last Modified: 28 Aug 2021 07:11

Actions (login required)

View Item View Item