Internship: External projection to add display capabilities to shape-changing interactive objects
Shape-changing interfaces (SCI) are tangible interfaces able to change their physical shape to support input, output or both [Alexander et al. 2018]. Past research on SCI has focused on enabling technologies to control the deformation of physical objects. However, a graphical feedback is a very common and high troughput channel of many forms of Human-Computer Interaction (HCI). Current SCI offer too limited, too little robust, graphical feedback for in-depth user experiments [Alexander et al. 2018]. The goal of the project is to study the feasability and the performance of simulating high definition graphical feedback on deformable object by using an external video projector.
Using external projection to change the appearance of physical objects has been studied in the context of Spatial Augmented Reality [Bimber et al. 2019]. Projection can be used on tracked moving objects to create a container illusion [Berard et al. 2017]. However, the projection of high resolution graphical feeback on moving deformable objects is a more challenging problem.
The student will study the state of the art about augmenting deformable object with external projection. She will design an approach that is as generic as possible to allow external projection on objects of various shapes and having various type of deformations. She will protype a system to augment at least two types of objects, e.g. :
1. A bendable and/or extensible surface [Khalilbeigi et al. 2011, Ortega and Goguey 2019, Sarkis et al. 2019],
2. A soft deformable objects based on structured elastomer [Siéfert et al. 2019]
The student will then evaluate the prototype.
Applicants
The internship requires making (e.g., 3D printing), coding (C++, 3D graphics) and statistics skills. If you feel unsure about your skills but are interested in the topic, contact us.
References
Jason Alexander, Anne Roudaut, Jürgen Steimle, Kasper Hornbæk, Miguel Bruns Alonso, Sean Follmer, and Timothy Merritt. 2018. Grand Challenges in Shape-Changing Interface Research. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, Paper 299, 1–14. DOI:https://doi.org/10.1145/3173574.3173873
Bimber, Oliver, and Ramesh Raskar. Spatial augmented reality: merging real and virtual worlds. AK Peters/CRC Press, 2019.
Bérard, F. et Louis, T. (2017) The Object Inside: Assessing 3D Examination with a Spherical Handheld Perspective-Corrected Display, in ACM conference on Computer-Human Interaction (CHI), Denver, USA.
Mohammadreza Khalilbeigi, Roman Lissermann, Max Mühlhäuser, and Jürgen Steimle. 2011. Xpaaand: interaction techniques for rollable displays. Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. Association for Computing Machinery, New York, NY, USA, 2729–2732. DOI:https://doi.org/10.1145/1978942.1979344
Michael Ortega and Alix Goguey. 2019. BEXHI: A Mechanical Structure for Prototyping Bendable and EXpandable Handheld Interfaces. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (ISS '19). Association for Computing Machinery, New York, NY, USA, 269–273. DOI:https://doi.org/10.1145/3343055.3359703
Mira Sarkis, Céline Coutrix, Laurence Nigay, and Andrzej Duda. 2019. WiBend: Wi-Fi for Sensing Passive Deformable Surfaces. In 2019 International Conference on Multimodal Interaction (ICMI '19). Association for Computing Machinery, New York, NY, USA, 339–348. DOI:https://doi.org/10.1145/3340555.3353746
Siéfert, E., Reyssat, E., Bico, J. et al. Bio-inspired pneumatic shape-morphing elastomers.Nature Mater 18, 24–28 (2019). https://doi.org/10.1038/s41563-018-0219-x, https://blog.espci.fr/benoitroman/en/baromorph/