Atheia: Employing Redis in developing a visual aid for real-time object search

By Pranav Ravella, Eugene Choi, Irfan Nafi, Raffu Khondaker

Atheia is a glove that serves as a visual aid for the blind and works concurrently with a mobile app. Using Redis Bit Fields and Strings, the image and appropriate user data is sent to an VPC instance. Using this data, the user can choose one of our five main features: Scan (describing the objects surrounding the user), Text (reading out any text found in the image), Observations (takes questions that look for details in an image), Search (guides users towards the desired objects which they choose through a system of vibrations), and Last Seen (returns the time, place, and location an object was last seen). To activate a feature, the user just has to give an audio command.

Because we run multiple models in parallel, we use Redis to communicate between the scripts since they run independently of each other. We used the Redis database to store our variables across our 3 interfaces, the microcontroller, the app, and the server. Thanks to Redis’s queue service, we were able to simplify the process needed to manage all our machine learning services. With these technologies, we were able to create an affordable device and assist one of our most resilient communities: the visually impaired.