SmartFinger: An Augmented Finger as a Seamless 'Channel' between Digital and Physical Objects

One of the key characteristics shared by both digital devices and physical objects is their physical appearance such as colors, dimensions, textures, etc. This motivated us to use visual information to connect devices, objects and people. Our goal was to make this interaction seamless by developing a technology that feels like a natural extension of the body and behavior. For example, a person might be able to point at a device and make a virtual connection to it, point at an object to extract/copy relevant information, point at another person to share digital contents, etc. To this end, we develop SmartFinger with the aim of creating a seamless ‘channel’ between digital devices and physical surrounding. It is an always available and intuitive interface for ‘grasping’ and semantically analyzing visual content from physical objects as well as sharing media between digital devices.


  • Shanaka Ransiri, Roshan Lalintha Peiris, Kian Peen Yeo and Suranga Nanayakkara. 2013. SmartFinger: Connecting Devices, Objects and People seamlessly. In Proceedings of the 24th conference of the computer-human interaction special interest group of Australia on Computer-human interaction(OZCHI ’13). ACM, New York, NY, USA. [PDF]
  • Ransiri S. and Nanayakkara S.C. “SmartFinger: An Augmented Finger as a Seamless ‘Channel’ between Digital and Physical Objects”, ACM SIGCHI Augmented Human, March, 2013. [PDF]