Skip to main content

Affectiva and Nuance to develop humanised automotive assistant

US company Affectiva plans to develop a joint automotive assistant which detects driver distraction and drowsiness and voices recommendations such as navigating to a coffee shop. The solution is intended to align its dialogue to a motorist’s emotional state based on facial and verbal expressions. The integrated solution will combine the Affectiva Automotive AI solution with UK-based Nuance Communications’ Dragon Drive platform. Affectiva Automotive AI measures facial expressions and emotions such as anger
September 7, 2018 Read time: 2 mins

US company Affectiva plans to develop a joint automotive assistant which detects driver distraction and drowsiness and voices recommendations such as navigating to a coffee shop. The solution is intended to align its dialogue to a motorist’s emotional state based on facial and verbal expressions.

The integrated solution will combine the Affectiva Automotive AI solution with UK-based Nuance Communications’ Dragon Drive platform.

Affectiva Automotive AI measures facial expressions and emotions such as anger and surprise as well as verbal expressions in real-time. It also displays icons which indicate drowsiness such as yawning, eye closure and blink rates and physical or mental distraction.

Through the partnership, Dragon Drive will enable the in-car assistant to interact with passengers via emotion and cognitive state detection. It currently facilitates this correspondence through gesture, touch, gaze detection, voice recognition powered by natural language understanding.

Stefan Ortmanns, executive vice president and general manager, Nuance Automotive, says these additional modes of interaction will help its OEM partners develop automotive assistants which can ensure the safety and efficiency of connected and autonomous cars.

In the future, the automotive assistant may also be able to take control of semi-autonomous vehicles if the driver displays signs of physical or mental distraction.

Related Content

  • Driver monitoring systems ‘will use inward-looking camera-based technology’
    November 9, 2015
    New analysis from Frost & Sullivan, Original Equipment Manufacturer (OEM) Strategies for Driver Monitoring Systems in Europe, indicates that, as the loss of driver attention due to fatigue or drowsiness is a common cause of road accidents worldwide, there is a clear need for driver monitoring systems (DMSs) globally. DMSs can analyse driver behaviour or detect patterns tending towards micro-sleep to issue appropriate warnings and help revive the driver’s focus. Several original equipment manufacturers (O
  • Eyesight monitors driver blink rate
    April 29, 2020
    Eyesight Technologies has entered an agreement to provide eye-related data on a driver operating a test vehicle at Israel's Aerial University. 
  • Advanced in-vehicle user interface - future developments
    February 1, 2012
    Dave McNamara and Craig Simonds, Autotechinsider LLC, look at human-machine interface development out to 2015. The US auto industry is going through the worst crisis it has faced since the Great Depression. But it has embraced technologies that will produce the best-possible driving experience for the public. Ford was the first OEM to announce in-car internet radio and SYNC, its signature-branded User Interface (UI), is held up as the shining example of change embracement.
  • Huawei is accelerating intelligence
    April 9, 2025
    At MWC Barcelona 2025, Huawei released seven new smart transportation solutions and set out its philosophy for the use of AI to support safety and efficiency gains