Skip to main content

New software could detect when people text and drive

Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.
September 20, 2017 Read time: 2 mins
Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.


Fakhri Karray, an electrical and computer engineering professor and director of the Centre for Pattern Analysis and Machine Intelligence (CPAMI) at Waterloo, said that information could be used to improve road safety by warning or alerting drivers when they are dangerously distracted. As advanced self-driving features are increasingly added to conventional cars, he said, signs of serious driver distraction could be employed to trigger protective measures.

“The car could actually take over driving if there was imminent danger, even for a short while, in order to avoid crashes,” said Karray.

Algorithms at the heart of the technology were trained using machine-learning techniques to recognise actions such as texting, talking on a cellphone or reaching into the backseat to retrieve something. The seriousness of the action is assessed based on duration and other factors.

That work builds on extensive previous research at CPAMI on the recognition of signs, including frequent blinking, that drivers are in danger of falling asleep at the wheel. Head and face positioning are also important cues of distraction.

Ongoing research at the centre now seeks to combine the detection, processing and grading of several different kinds of driver distraction in a single system.

“It has a huge impact on society,” said Karray, citing estimates that distracted drivers are to blame for up to 75 per cent of all traffic accidents worldwide.

Related Content

  • AVs in the Netherlands? Don't forget the bikes
    June 11, 2019
    The Netherlands’ famous love of bicycles could be a problem when it comes to the deployment of autonomous vehicles there. And there might be other obstacles, finds Ben Spencer Of all the countries on the planet, the Netherlands is most ready to start deploying autonomous vehicles (AVs), according to a survey by KPMG earlier this year. On the face of it, this is good news: coming first out of 25 countries listed in the Autonomous Vehicles Readiness Index (AVRI) for the second consecutive year puts the Du
  • Data provides structural support for BQE
    July 28, 2025
    Thousands of bridges in the US are ageing and in need of care and attention. Kistler explains how its WiM technology is helping to preserve New York’s famous Brooklyn-Queens Expressway…
  • CRASH Predicts ‘unpredictable’ in traffic incidents
    November 11, 2015
    Road crashes are not as random as they may appear and analysing data can reveal patterns that can help various authorities target their resources more accurately. David Crawford reports. Figures from the US National Highway Traffic Safety Administration (NHTSA) show that in 2013 there were 32,719 people killed on American roads and 2.31 million injured. While these form part of an overall 25% drop over the decade from 2004, US Transportation Secretary Anthony Foxx continues to stress that reaching the procl
  • Last call for Canberra drivers
    November 23, 2022
    Australian capital aims to crack down on motorists using their phones at the wheel