Visual help for the visually impaired
Identity theft is a problem that affects almost everybody, but the visually impaired is affected more by it.
Our android application aims to solve this problem by using face recognition and object detection.
This is the general flow of our app: The visually impaired person wears the phone like an id card with the screen facing outside. Earphones are also connected to the app.
By default, the app is in detection mode. If a known Person approaches the visually impaired person, the camera picks up the persons face and sends the person’s name as an audio message to the visually impaired person.
If an unknown person approaches the visually impaired person, the visually impaired person clicks the volume down button(switches to recognition mode) and gives the phone to the unknown person who would then state his name and then the phone’s camera will scan his face and add it to the list of known faces.
Another important feature of this app is the object detection built into it. When the visually impaired person clicks the volume up button, the app switches to sentry mode in which this person can point to one direction and take a photo and then the app would send an audio message explaining about all the things in that direction. (ex: There are 2 persons in that direction)
First, clone the repo,
$git clone https://github.com/bnair2001/oculli.git
Then run,
$pip3 install requirements
$pip3 install torchvision
if the above dosent work then use,
$pip3 --no-cache-dir install torchvision
Then to run the API,
$flask run
Open the android folder in this repo using android studio and build the android app.
PS: The build may take about 20 minutes
