Laboratory of Informatics of Grenoble Engineering Human-Computer Interaction Research Group

Engineering Human-Computer Interaction
Research Group

COMM Notation for Specifying Collaborative and MultiModal Interactive Systems

In Proceedings of the second ACM SIGCHI Symposium on Engineering Interactive Computing Systems (Berlin, Germany - June 19-23, 2010) (EICS 2010). pages 125-134. 2010.

Frédéric Jourde, Yann Laurillau, Laurence Nigay


Multi-user multimodal interactive systems involve multiple users that can use multiple interaction modalities. Although multi-user multimodal systems are becoming more prevalent (especially multimodal systems involving multitouch surfaces), their design is still ad-hoc without properly keeping track of the design process. Addressing this issue of lack of design tools for multi-user multimodal systems, we present the COMM (Collaborative and MultiModal) notation and its on-line editor for specifying multi-user multimodal interactive systems. Extending the CTT notation, the salient features of the COMM notation include the concepts of interactive role and modal task as well as a refinement of the temporal operators applied to tasks using the Allen relationships. A multimodal military command post for the control of unmanned aerial vehicles (UAV) by two operators is used to illustrate the discussion.