If your browser has the QuickTime plug-in, please go to the QuickTime enhanced version of this page.
FingerPaint title
FingerPaint is a demonstration system in which computer vision is used to allow people to interact with the system using several devices, such as a pen, an eraser, or even bare fingers.
For the demonstration, the display of a simple drawing program is projected on the wall using a datashow. A video camera grabbs the live image of the wall and the user; and provide it to a computer running the vision processing system.
hardware setup
drawing with a finger
In the first clip, a person uses his finger to write some text on the wall. He then scrolls the drawing with the hand. The scrolling of the text illustrate a feature that would not be possible with a real board using real ink.
Click on the picture to get a bigger one. Get the clip as a QuickTime movie (3.6 Mo) or an MPEG movie (1.9 Mo).
The vision system can accomodate any pointer objects. In this second clip, a pen is used to draw with the "virtual ink" on the wall.
Click on the picture to get a bigger one. Get the clip as a QuickTime movie (3.5 Mo) or an MPEG movie (1.8 Mo).
drawing with a pen
mix of real/virtual objects
The next clip illustrate the possibility to mix real word objects with virtual ones. An apple, drawn on a slide, is used as a template for a virtual drawing.
Click on the picture to get a bigger one. Get the clip as a QuickTime movie (2.7 Mo) or an MPEG movie (2.3 Mo).
Finally, the last clip envision a collaborative system. Here, the projected display comes from a remote location. A distant person is playing a game with the one interacting locally with FingerPaint.
Click on the picture to get a bigger one. Get the clip as a QuickTime movie (2.2 Mo) or an MPEG movie (2 Mo).
collaborative game
FingerPaint was developped by François Bérard, under Joëlle Coutaz and James L. Crowley advises. For more information about the motivations of this work, as well as the vision techniques involved, please refer to the paper " Finger Tracking as an Input Device for Augmented Reality" or the DEA report (master's thesis, in french) " Vision par Ordinateur pour la Realité Augmentée : Application au Bureau Numérique" .

The system uses an Apple Macintosh Quadra 840av (40 Mhz M68040 processor).

François IIHM CLIPS IMAG

created on feb 25, 1997 by François Bérard.