We introduce a HoloLens based system to provide three key features to DHH users: automatic speech transcription, sound localization, and sound identity.
- Unity (2018.2.21f1)
- HoloLens 1
Open HoloSoundUnity in Unity. Change build setting to UWP and use IL2CPP as backend. Build project and run it on HoloLens.
Open Assets/CaptionController.cs and change variables SERVER_URL and SERVER_PORT to the corresponding values of the sound recognition server. Instructions for the sound recognition server can be found at SoundRecognitionServer/README.md
Contact Greg or Robin @MakeabilityLab through email grgrggtr@cs.washington.edu and yangy87@cs.washington.edu
Developed with Dhruv Jain and collaborators at the Makeability Lab
- HomeSound: An Iterative Field Deployment of an In-Home Sound Awareness System for Deaf or Hard of Hearing Users