Login
       
  • Audio-visual-olfactory resource allocation for tri-modal virtual environments

Doukakis, Efstratios, Debattista, Kurt, Bashford-Rogers, Thomas, Dhokia, Amar, Asadipour, Ali, Chalmers, Alan and Harvey, Carlo, 2019, Journal Article, Audio-visual-olfactory resource allocation for tri-modal virtual environments IEEE Transactions on Visualization and Computer Graphics, 25 (5). pp. 1865-1875. ISSN 1077-2626

Abstract or Description:

Virtual Environments (VEs) provide the opportunity to simulate a wide range of applications, from training to entertainment, in a safe and controlled manner. For applications which require realistic representations of real world environments, the VEs need to provide multiple, physically accurate sensory stimuli. However, simulating all the senses that comprise the human sensory system (HSS) is a task that requires significant computational resources. Since it is intractable to deliver all senses at the highest quality, we propose a resource distribution scheme in order to achieve an optimal perceptual experience within the given computational budgets. This paper investigates resource balancing for multi-modal scenarios composed of aural, visual and olfactory stimuli. Three experimental studies were conducted. The first experiment identified perceptual boundaries for olfactory computation. In the second experiment, participants (N = 25) were asked, across a fixed number of budgets (M = 5), to identify what they perceived to be the best visual, acoustic and olfactory stimulus quality for a given computational budget. Results demonstrate that participants tend to prioritize visual quality compared to other sensory stimuli. However, as the budget size is increased, users prefer a balanced distribution of resources with an increased preference for having smell impulses in the VE. Based on the collected data, a quality prediction model is proposed and its accuracy is validated against previously unused budgets and an untested scenario in a third and final experiment.

Official URL: http://dx.doi.org/10.1109/TVCG.2019.2898823
Subjects: Other > Mathematical and Computer Sciences > G100 Mathematics
Other > Mathematical and Computer Sciences > G400 Computer Science
Other > Mathematical and Computer Sciences > G600 Software Engineering
Other > Engineering > H600 Electronic and Electrical Engineering > H610 Electronic Engineering
Other > Engineering > H600 Electronic and Electrical Engineering > H670 Robotics and Cybernetics > H674 Virtual Reality Engineering
School or Centre: Research Centres > Computer Science Research Centre
Research & Innovation
Funders: WMG, Jaguar Land Rover (JLR)
Identification Number or DOI: https://doi.org/10.1109/TVCG.2019.2898823
Date Deposited: 09 Jan 2020 15:20
Last Modified: 12 Jan 2021 19:07
URI: https://researchonline.rca.ac.uk/id/eprint/4242
Edit Item (login required) Edit Item (login required)