New software could detect when people text and drive

Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.
September 20, 2017 Read time: 2 mins
Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.


Fakhri Karray, an electrical and computer engineering professor and director of the Centre for Pattern Analysis and Machine Intelligence (CPAMI) at Waterloo, said that information could be used to improve road safety by warning or alerting drivers when they are dangerously distracted. As advanced self-driving features are increasingly added to conventional cars, he said, signs of serious driver distraction could be employed to trigger protective measures.

“The car could actually take over driving if there was imminent danger, even for a short while, in order to avoid crashes,” said Karray.

Algorithms at the heart of the technology were trained using machine-learning techniques to recognise actions such as texting, talking on a cellphone or reaching into the backseat to retrieve something. The seriousness of the action is assessed based on duration and other factors.

That work builds on extensive previous research at CPAMI on the recognition of signs, including frequent blinking, that drivers are in danger of falling asleep at the wheel. Head and face positioning are also important cues of distraction.

Ongoing research at the centre now seeks to combine the detection, processing and grading of several different kinds of driver distraction in a single system.

“It has a huge impact on society,” said Karray, citing estimates that distracted drivers are to blame for up to 75 per cent of all traffic accidents worldwide.

Related Content

  • May 10, 2019
    SafeRide: it’s time to act on cyberattacks
    Cyber threats are increasing rapidly and conventional security measures are unable to keep up. Ben Spencer talks to SafeRide’s Gil Reiter about what OEMs can do now As more vehicles become connected, so the potential threats to their security increase. Gil Reiter, vice president of product management for security firm SafeRide, says the biggest ‘attack surface’ for connected cars is their internet connectivity - and the in-vehicle applications that use the internet connection. “The most vulnerable co
    Read More
  • August 29, 2019
    Don’t drive drunk – or use a hands-free phone
    Despite law changes, drivers’ bad habits have been creeping back in. TRL’s Dr Shaun Helman tells Adam Hill why using a phone at the wheel is just as distracting as driving after a few drinks esearch from as far back as 2002 (see box) suggests that driving while making a phone call – either hands-free or holding a handset to your ear – creates the same amount of distraction as being drunk behind the wheel. While it is notoriously hard to predict how alcohol will affect an individual (due to the speed of
    Read More
  • March 4, 2019
    TISPOL says gig economy tears up enforcement rulebook
    The road safety enforcement sector is facing a crisis. Rulebooks around the world are going to have to change as our roads become a high-pressure workplace for millions of gig economy workers. Geoff Hadwick reports from the TISPOL conference Traffic police forces everywhere will need a fresh approach to regulating the way in which our highways are being used, senior enforcement officers were told at the latest TISPOL European Traffic Police Network annual conference. The World Health Organisation puts it
    Read More
  • June 29, 2018
    Avoiding the call of the wild
    Hitting an animal on a rural road can be fatal for all parties involved – but detecting and avoiding them requires clever technology. Andrew Williams carefully scans the horizon for details. Wildlife-vehicle collisions are an ever-present threat in rural areas around the world, and there is certainly nothing funny about suddenly finding an angry moose in your headlights on a sharp bend. A variety of detection and avoidance systems are currently in use or under development to help prevent your vehicle being
    Read More

Highlighted Content