FingerReader-v0
Accessing printed text in a mobile context is a major challenge for the blind. In this project, we conceptualise and design a finger-worn device, FingerReader, that assists blind users with reading printed text on the go. We introduce a novel computer vision algorithm for local-sequential text scanning that enables reading single lines, blocks of text or skimming the text with complementary, multimodal feedback. This system is implemented in a small finger-worn form factor, that enables a more manageable eyes-free operation with trivial setup. We also look to go beyond usage for persons with a visual impairment, and expect that the FingerReader may be useful to scaffold dyslexic readers, support early language learning for preschool children and reading non-textual languages.
For more information about FingerReader, it's conception, future directions and alternatives please contact us.
The industrial design was done by Jonathan Ng Ming-En and Sanjay Pushparajan.
PUBLICATIONS
FingerReader: A Wearable Device to Explore Printed Text on the Go
Shilkrot, R., Huber, J., Meng Ee, W., Maes, P. and Nanayakkara, S.C., 2015, April. FingerReader: a wearable device to explore printed text on the go. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (pp. 2363-2372).
Digital Digits: A Comprehensive Survey of Finger Augmentation Devices
Shilkrot, R., Huber, J., Steimle, J., Nanayakkara, S.C. and Maes, P., 2015. Digital digits: A comprehensive survey of finger augmentation devices. ACM Computing Surveys (CSUR), 48(2), pp.1-29.
FingerReader: A Wearable Device to Support Text-Reading on the Go
Shilkrot, R., Huber, J., Liu, C., Maes, P. and Nanayakkara, S.C., 2014. FingerReader: a wearable device to support text reading on the go. In CHI'14 Extended Abstracts on Human Factors in Computing Systems (pp. 2359-2364).
A Wearable Text-Reading Device for the Visually-Impaired
Shilkrot, R., Huber, J., Liu, C., Maes, P. and Nanayakkara, S.C., 2014. A wearable text-reading device for the visually-impaired. In CHI'14 Extended Abstracts on Human Factors in Computing Systems (pp. 193-194).