Controlling Your Car With Gestures

PoC for a major German automotive company: A unique user interface with gesture recognition for control over the central console.

Client
Year
2017
Expertise
IoT/Embedded Development
The Outcome

Our Final Result

Overview

Team Size
2 People
Maturity Level
Proof of Concept

Challenge

The use case involved swiping your hand to receive or cancel calls with a SmartWatch as the device for gesture recognition. The information would be sent directly to the car.

Solution

We created a deep learning model to recognize some predefined hand gestures like swipe right/left, tap, etc. As a result, we converted that model to Apple’s own CoreML model that allowed us to run the neural network directly on the Apple Watch.

Technologies

  • Keras
  • CoreML
  • Python
  • TensorFlow
  • WatchOS

Impact

This project was a technical Proof of Concept showcasing a unique user interface: gesture recognition while driving.Users were able to control the entertainment system of the car with simple hand gestures.

The Outcome

Our Final Result

Result

Looking for an
Innovation Partner?

Contact Us

Challenge

Solution

Overview

The Process