New software could detect when people text and drive

Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.
September 20, 2017 Read time: 2 mins
Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.


Fakhri Karray, an electrical and computer engineering professor and director of the Centre for Pattern Analysis and Machine Intelligence (CPAMI) at Waterloo, said that information could be used to improve road safety by warning or alerting drivers when they are dangerously distracted. As advanced self-driving features are increasingly added to conventional cars, he said, signs of serious driver distraction could be employed to trigger protective measures.

“The car could actually take over driving if there was imminent danger, even for a short while, in order to avoid crashes,” said Karray.

Algorithms at the heart of the technology were trained using machine-learning techniques to recognise actions such as texting, talking on a cellphone or reaching into the backseat to retrieve something. The seriousness of the action is assessed based on duration and other factors.

That work builds on extensive previous research at CPAMI on the recognition of signs, including frequent blinking, that drivers are in danger of falling asleep at the wheel. Head and face positioning are also important cues of distraction.

Ongoing research at the centre now seeks to combine the detection, processing and grading of several different kinds of driver distraction in a single system.

“It has a huge impact on society,” said Karray, citing estimates that distracted drivers are to blame for up to 75 per cent of all traffic accidents worldwide.

Related Content

  • UK defaults to hard shoulder running to expand motorway capacity
    April 8, 2014
    Hard shoulder running has become the UK’s default response to increasing motorway capacity as Colin Sowman reports. Facing a predicted 46% increase in traffic levels by 2040 and the current economic recovery leading to more people travelling to, from and for work leaves the UK government under short- and long-term pressure to increase the capacity on the main motorway network. Particular sections of motorways are already experiencing repeated, sometimes tidal, congestion and both tight Treasury limits and t
    Read More
  • New services and equipment helps cities tackle air quality issues
    September 19, 2017
    With poor urban air quality shortening lives and fines being imposed for breaching pollution limits, authorities are seeking ways to clean up their cities. Poor air quality is topping the agenda for city authorities across the globe. In the UK, for example, a report from the Royal Colleges of Physicians and of Paediatrics and Child Health, concluded that poor outdoor air quality shortens the lives of around 40,000 people a year – principally by undermining the health of people with heart and/or lung prob
    Read More
  • Brigade detects potential collisions
    November 24, 2021
    Algorithm designed to calculate risk of a vehicle hitting cyclists and pedestrians nearby
    Read More
  • NHTSA studies hacking risks to automated vehicles
    May 21, 2013
    A report by Bloomberg says that rising hacking risks to drivers as their cars become increasingly powered by and connected to computers have prompted the US’s auto-safety regulator to start a new office focusing on the threat. “These interconnected electronics systems are creating opportunities to improve vehicle safety and reliability, but are also creating new and different safety and cybersecurity risks,” David Strickland, head of the National Highway Traffic Safety Administration, said at a recent Senat
    Read More

Highlighted Content