WiBend: Recognizing Bending Interaction for Passive Deformable Surfaces with Wi-Fi
In Proceedings of the 21st ACM International Conference on Multimodal Interaction (ICMI ’19). pages 339-348. 2019.
Mira Sarkis, Céline Coutrix, Laurence Nigay, Andrzej Duda
Abstract
We present WiBend, a system that recognizes bending ges- tures as the input modalities for interacting on non-instrumented and deformable surfaces using WiFi signals. WiBend takes advantage of off-the-shelf 802.11 (Wi-Fi) devices and Channel State Information (CSI) measurements of packet transmissions when the user is placed and interacting between a Wi-Fi transmitter and a receiver. We have performed extensive user experiments in an instrumented laboratory to obtain data for training the HMM models and for evaluating the precision of WiBend. During the experiments, participants performed 12 distinct bending gestures with three surface sizes, two bending speeds and two different directions. The performance evaluation results show that WiBend can distinguish between 12 bending gestures with a precision of 84% on average.