Internship on Creating a High Definition Augmented Reality Head Mounted Display
Background
Augmenting people's field of view through head-mounted displays (HMD) is sometimes seen as the next era of human-computer interaction (HCI). Some challenges remain to be solved for this era to become reality. HMDs need to be miniaturized to the level of prescription glasses. HMDs need to have autonomous tracking that is stable and has no perceivable latency. New forms of HCIs need to be invented.
Context
Current commercial Augmented Reality (AR) HMD don't provide stable and fast enough tracking to create a faithful augmentation of users' field of view. Hence, all usability evaluations of novel HCI are polluted with technical limitations: are the problems arising from a non-optimal HCI or from the imperfect augmentation?
Our research group has a high-resolution visual tracking system (Optitrack) and large field of view see-through HMDs (Meta-2). The built-in tracking system of the HMD can be replaced by the high-quality external tracking system. This should provide a notable improvement of the perceived augmentation, and thus to allow more accurate evaluations of the usability of novel HCI for AR HMDs.
Objective of the internship
The intern will be in charge of creating a calibration procedure and a software to allow the development of high-quality AR application with the Meta-2 HMD and Optitrack visual tracking. This includes:
- Modeling the deformation created by the curved see-through display of the HMD.
- Inverting the deformation to pre-warp straight images sent to the display.
- Implementing a protocol to measure correspondences between world locations and their corresponding projections on the display.
- Estimating (optimizing) the world-to-display projection using previously recorded correspondences.
- Quantifying the performances of the system (precision, latency).
- Getting informal feedback from user testing the created system and other systems used in the group (i.e. native Meta-2, native MS Hololens).
Advisor
References
- Y. Itoh, J. Orlosky, M. Huber, K. Kiyokawa, and G. Klinker. Ost rift: Temporally consistent augmented reality with a consumer optical see-through head-mounted display. In Virtual Reality (VR), pages 189– 190. IEEE, 2016.
- Y. Genc, M. Tuceryan, and N. Navab. Practical solutions for calibration of optical see-through devices. In Proceedings. International Symposium on Mixed and Augmented Reality, pages 169–175, Oct 2002.
- High-Precision, Low-latency (non-HMD) AR in the group.
This work will be conducted in the context of the contract Anat2020.