Microsoft LucidTouch Concept

Microsoft has shown off a new prototype device called LucidTouch that allows users to control a device from behind, but while still being able to see their fingers. LucidTouch also supports multi-touch input, allowing users to operate the device simultaneously with all 10 fingers. The key to making this usable is what it calls pseudo-transparency: by overlaying an image of the user’s hands onto the screen, the illusion of the mobile device itself being semitransparent is created.

According to the company, many direct touch input devices provide only two input states: out-of-range and dragging, the assumption being that the user's finger or stylus provides feedback in order to anticipate the point of interaction. When the hands are behind the display, this visual tracking is not possible. Their pseudo-transparency approach allows users to see their hands as they are attempting to acquire a target from the back of the device, thus solving not only the occlusion problem, but also the lack of tracking feedback. In order to overcome the fat finger problem, simple computer-vision techniques are applied, allowing each finger's touch points to be visualised prior to making contact with the touchpad. As a result, LucidTouch enables fast and intuitive land-on selection, in contrast to the take-off selection techniques other opaque devices employ. Check out video below.