Controlling Your Car with Gestures
This project was a technical Proof of Concept showcasing a unique user interface: gesture recognition while driving. The use case involved swiping your hand to receive or cancel calls with a SmartWatch as the device for gesture recognition. The information would be sent directly to the car.
We created a deep learning model to recognize some predefined hand gestures like swipe right/left, tap, etc. As a result, we converted that model to Apple’s own CoreML model that allowed us to run the neural network directly on the Apple Watch. Users were able to control the entertainment system of the car with simple hand gestures.