Tele-Touch [2016 - 2018]

Robotics offers an efficient way for assistive devices to maintain many errands. In this study it is aimed to present a proof of concept robotic study that is called TeleTouch. TeleTouch is a robotic system that allows mimicking user’s finger motions/gestures to be transferred in a desired remote location with in an acceptable delay. In the implementation Leap motion sensor, Raspberry Pi, and Arduino systems are used. 3D printers printed Hand model is actuated by Arduino system which is responsible for driving the servo motors connected the hand model. Raspberry PI is used not only for transferring camera view of the hand model to the controlling remote system but also it is used for transferring to finger attributes to the Arduino system. A software is developed in .Net platform to gather the user’s attributes of the fingers from leap motion sensor system. Delay times of the local and remote system investigated and understood that proposed system successfully transfer motion in almost real time

Paper Github

Video

Video

Pic-Talk [2017-2019]

Open source Pic-Talk platform aims to establish an ecosystem to improve the educational and social lives of individuals with vision loss, promoting equal access and opportunity. Pic-Talk can provide multi-modal feedback to three important senses of visually impaired individuals in an integrated manner. In particular, the interface provides senses of touch, audition and sight (for low vision aid). Pic-Talk ecosystem consists of both hardware and software components. The hardware components include a “shape-display” that presents 8x8 drawings for visually impaired individuals and a “smart glove” that provides vibrotactile feedback to help the visually impaired individuals to understand abstract
concepts such as color.

Github

Video

Video