Project Description

Controlling Your Car with Gestures

THE CHALLENGE

This project was a technical Proof of Concept showcasing a unique user interface:  gesture recognition while driving. The use case involved swiping your hand to receive or cancel calls with a SmartWatch as the device for gesture recognition. The information would be sent directly to the car.

THE SOLUTION

We created a deep learning model to recognize some predefined hand gestures like swipe right/left, tap, etc. As a result, we converted that model to Apple’s own CoreML model that allowed us to run the neural network directly on the Apple Watch. Users were able to control the entertainment system of the car with simple hand gestures.

TECHNOLOGIES

  • Keras
  • CoreML
  • Python
  • TensorFlow
  • WatchOS

TEAM SIZE

YEAR

  • 2017

Machine Learning
Cheat Sheet

We’ve summarized all you need to know about machine learning.
Check it out!

Download