Kiwi Sign is a project developed for the DEVS Hackathon 2024. It utilises an ML model to recognise and interpret New Zealand Sign Language. The app features a "SignDex" (akin to a PokeDex), which records new signs when they are first observed. The SignDex is organised into categories such as Greetings, Numbers, etc.
- A dataset containing 100 images for each sign. These signs included:
- Alphabet: A, B, C
- Numbers: 1 - 9
- Days of the Week: Monday - Sunday
- Greetings: Hello, Goodbye, Thank you
- Terms: Mountain, Marae, Food
- An ML model that can provide live translation from NZSL to English and Te Reo
- A SignDex, which records all hand signs recognised by the user
kiwi-sign.mov
This project was made possible by the efforts of:
- Eason Jin,
- Noah Hagar-Dent,
- Isabel Body, and
- Seif Farah
First cd into client, then run python3 app.py. This will create a Flask server, which can be used to access Kiwi Sign.