• DeepMetricEye: Metric depth estimation in periocular VR imagery

Sun, Yitong ORCID: https://orcid.org/0000-0002-9469-7157, Zhou, Zijian, Diels, Cyriel and Asadipour, Ali ORCID: https://orcid.org/0000-0003-0159-3090, 2023, Conference or Workshop, DeepMetricEye: Metric depth estimation in periocular VR imagery at ISMAR 2023, Sydney, Australia, 16-20 Oct 2023.

Abstract or Description:

Despite the enhanced realism and immersion provided by VR headsets, users frequently encounter adverse effects such as digital eye strain (DES), dry eye, and potential long-term visual impairment due to excessive eye stimulation from VR displays and pressure from the mask. Recent VR headsets are increasingly equipped with eye-oriented monocular cameras to segment ocular feature maps. Yet, to compute the incident light stimulus and observe periocular condition alterations, it is imperative to transform these relative measurements into metric dimensions. To bridge this gap, we propose a lightweight framework derived from the U-Net 3+ deep learning backbone that we re-optimised, to estimate measurable periocular depth maps. Compatible with any VR headset equipped with an eye-oriented monocular camera, our method reconstructs three-dimensional periocular regions, providing a metric basis for related light stimulus calculation protocols and medical guidelines. Navigating the complexities of data collection, we introduce a Dynamic Periocular Data Generation (DPDG) environment based on UE MetaHuman, which synthesises thousands of training images from a small quantity of human facial scan data. Evaluated on a sample of 36 participants, our method exhibited notable efficacy in the periocular global precision evaluation experiment, and the pupil diameter measurement.

Official URL: https://www.computer.org/csdl/proceedings-article/...
Subjects: Other > Mathematical and Computer Sciences > G400 Computer Science
Other > Mathematical and Computer Sciences > G400 Computer Science > G440 Human-computer Interaction
School or Centre: Research Centres > Computer Science Research Centre
Identification Number or DOI: https://doi.org/10.1109/ISMAR59233.2023.00058
Date Deposited: 12 Sep 2023 14:14
Last Modified: 12 Jan 2024 10:34
URI: https://researchonline.rca.ac.uk/id/eprint/5525
Edit Item (login required) Edit Item (login required)