InSight is an intuitive technique to control smart objects with existing input devices in the environment, while simply looking at them. By leveraging the user’s line of sight as a heuristic of gaze and attention, the InSight system directs input focus from input devices to the device that the user is looking at, thus creating an intuitive metaphor: you control the object you are looking at. We contribute with technical details of the hardware and software implementation, and a discussion of single user and multi-user interaction possibilities.


  • Roger Boldu, Haimo Zhang, Juan Pablo, Sachith Muthukumarana and Suranga Nanayakkara. InSight: A Systematic Approach to Create Dynamic Human-Controller-Interactions. In Proceedings of the 8th Augmented Human International Conference (AH'17). ACM, Silicon Valley, LA, USA, Article No. 26. Best Short Paper Award! [PDF]