User Interfaces

We (Professors Elias and Westerman) have developed a novel device that improves our ability to control computers and manipulate graphical objects. The technology consists of a thin and flexible hand imaging surface of arbitrary size and shape that records an image of objects that approach it closely or that touch it.

We use easily repeated hand and finger motions (i.e., gestures) to execute operations that normally require multiple key strokes or point and click. We have also developed adaptive algorithms for our imaging surface that allows it to accept normal touch typing, mouse-like operations, and gestures from both hands, all in the same, overlapping area of the imaging surface. A photograph of a notebook computer with an integrated hand imaging surface appears below.

The technology is now available commercially to developers and OEMs at

[ back to John G. Elias' Website ]