PhoneTouch

PhoneTouch is a novel technique for integration of mobile phones and interactive surfaces. The technique enables use of phones to select targets on the surface by direct touch, facilitating for instance pick&drop-style transfer of objects between phone and surface. The technique is based on separate detection of phone touch events by the surface, which determines location of the touch, and by the phone, which contributes device identity. The device-level observations are merged based on correlation in time. We describe a proof-of-concept implementation of the technique, using vision for touch detection on the surface (including discrimination of finger versus phone touch) and acceleration features for detection by the phone.

PhoneTouch Enabling Technique

PhoneTouch Interaction Style

Related Publications

• Schmidt, D., Chehimi, F., Rukzio, E., and Gellersen, H.
  PhoneTouch: A technique for direct phone interaction on surfaces
  In Proceedings of UIST 2010, pp. 13-16
  PDF | Video | YouTube
• Schmidt, D., Seifert, J., Rukzio, E., and Gellersen, H.
  A Cross-Device Interaction Style for Mobiles and Surfaces
  In Proceedings of DIS 2012, pp. 318-327
  PDF | YouTube
• Patent application. Schmidt, D., Chehimi, F., Gellersen, H., and Rukzio, E. “Computer Interface Method”

In the Press

• Cell Phones Make a Touch Surface Smarter. In MIT Technology Review, October 6th, 2010.