New software could detect when people text and drive

Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.
September 20, 2017 Read time: 2 mins
Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.


Fakhri Karray, an electrical and computer engineering professor and director of the Centre for Pattern Analysis and Machine Intelligence (CPAMI) at Waterloo, said that information could be used to improve road safety by warning or alerting drivers when they are dangerously distracted. As advanced self-driving features are increasingly added to conventional cars, he said, signs of serious driver distraction could be employed to trigger protective measures.

“The car could actually take over driving if there was imminent danger, even for a short while, in order to avoid crashes,” said Karray.

Algorithms at the heart of the technology were trained using machine-learning techniques to recognise actions such as texting, talking on a cellphone or reaching into the backseat to retrieve something. The seriousness of the action is assessed based on duration and other factors.

That work builds on extensive previous research at CPAMI on the recognition of signs, including frequent blinking, that drivers are in danger of falling asleep at the wheel. Head and face positioning are also important cues of distraction.

Ongoing research at the centre now seeks to combine the detection, processing and grading of several different kinds of driver distraction in a single system.

“It has a huge impact on society,” said Karray, citing estimates that distracted drivers are to blame for up to 75 per cent of all traffic accidents worldwide.

Related Content

  • Most Honda owners turn off lane departure warning, says IIHS
    March 8, 2016
    Owners of Hondas with crash avoidance features are much more likely to have forward collision warning turned on than lane departure warning, IIHS researchers found in a recent observational survey. The researchers observed vehicles brought in to Honda dealerships for service. They found that all but one of 184 models equipped with the two features had forward collision warning turned on, while only a third of vehicles had lane departure warning activated. IIHS says the findings are consistent with pre
    Read More
  • Peter Norton: “My fear is that the technology itself is mistaken for the answer”
    August 5, 2022
    Peter Norton, author of Autonorama, tells Adam Hill why automakers kept the consumer dissatisfied, why Futurama got such a hold on the public imagination – and about how active travel can be promoted
    Read More
  • Data crunching ‘can prevent cars crashing’
    March 25, 2013
    Having already cut traffic collisions resulting in injuries and deaths by nearly forty per cent in five years by analysing patterns from data it has collected, the city of Edmonton, Canada, is using predictive technologies to increase road safety even more. The city’s Office of Traffic Safety (OTS) has installed as many as 200 digital signs as just one element of an innovative traffic safety program that has dramatically reduced vehicle collisions in the Edmonton region since OTS launched in late 2006. Unde
    Read More
  • Measuring the effectiveness of winter VMS
    August 5, 2013
    A survey into the effectiveness of weather-related variable message signs on a trans-mountain highway has some interesting results, as Alexis Bacelar told ITS Europe. A study in the Massif Central region of France evaluating the usefulness of winter weather warning signs has highlighted the effect of variable message signs on driver behaviour. During the winter of 2009-2010, road operator Massif Central Direction Interdépartementale des Routes (MC DIR) started installing bad weather-specific variable messag
    Read More

Highlighted Content