New software could detect when people text and drive

Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.
September 20, 2017 Read time: 2 mins
Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.


Fakhri Karray, an electrical and computer engineering professor and director of the Centre for Pattern Analysis and Machine Intelligence (CPAMI) at Waterloo, said that information could be used to improve road safety by warning or alerting drivers when they are dangerously distracted. As advanced self-driving features are increasingly added to conventional cars, he said, signs of serious driver distraction could be employed to trigger protective measures.

“The car could actually take over driving if there was imminent danger, even for a short while, in order to avoid crashes,” said Karray.

Algorithms at the heart of the technology were trained using machine-learning techniques to recognise actions such as texting, talking on a cellphone or reaching into the backseat to retrieve something. The seriousness of the action is assessed based on duration and other factors.

That work builds on extensive previous research at CPAMI on the recognition of signs, including frequent blinking, that drivers are in danger of falling asleep at the wheel. Head and face positioning are also important cues of distraction.

Ongoing research at the centre now seeks to combine the detection, processing and grading of several different kinds of driver distraction in a single system.

“It has a huge impact on society,” said Karray, citing estimates that distracted drivers are to blame for up to 75 per cent of all traffic accidents worldwide.

Related Content

  • Enforcement a key part of the road safety solution
    January 31, 2012
    The Partnership for Advancing Road Safety is a new organisation set up in the US to push the national debate on speed and intersection safety, something which hitherto has been absent. Here, executive director David Kelly explains the organisation's work. With moves to address drink/drug driving and the wearing of seatbelts starting to prove successful in the US, the use of inappropriate speed and poor driving at intersections have become responsible for a proportionately greater number of the deaths and in
    Read More
  • Nauto launches solution to eliminate distracted driving
    June 18, 2018
    Transportation company Nauto has launched its Prevent solution to help eliminate distracted driving by alerting motorists when their eyes have strayed off the road for too long. The company hopes to reduce accidents and collisions - before the large-scale arrival of autonomous vehicles. A report by TechCrunch says the device will send a voice notification if motorists are distracted for more than five seconds and are driving at 60mph. An alarm will follow if the user's attention has not returned to drivi
    Read More
  • Future for connected cars ‘looks promising, but obstacles remain’
    October 19, 2016
    A new report released today by The Economist Intelligence Unit (The EIU) highlights that the huge investment already going into research and development for connected vehicles is reaping rewards. However, several obstacles still remain – from privacy and security concerns, to a lack of infrastructure, the need for a legislative framework, issues around congestion and pollution and the very real threat from on-demand transport disruptors such as Uber and Lyft. Matt Kendall, telecoms analyst at The EIU, sa
    Read More
  • High-res traffic data provides planners with the big picture
    November 5, 2015
    Road authorities have a lot to gain from high-resolution traffic data, argues Pravin Varaiya. Traffic engineers have traditionally been forced to operate with limited data regarding the performance of their arterials. Traffic studies are often commissioned once every three years, over a few days, to get an updated estimate of utilization.
    Read More

Highlighted Content