Skip to main content

New software could detect when people text and drive

Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.
September 20, 2017 Read time: 2 mins
Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.


Fakhri Karray, an electrical and computer engineering professor and director of the Centre for Pattern Analysis and Machine Intelligence (CPAMI) at Waterloo, said that information could be used to improve road safety by warning or alerting drivers when they are dangerously distracted. As advanced self-driving features are increasingly added to conventional cars, he said, signs of serious driver distraction could be employed to trigger protective measures.

“The car could actually take over driving if there was imminent danger, even for a short while, in order to avoid crashes,” said Karray.

Algorithms at the heart of the technology were trained using machine-learning techniques to recognise actions such as texting, talking on a cellphone or reaching into the backseat to retrieve something. The seriousness of the action is assessed based on duration and other factors.

That work builds on extensive previous research at CPAMI on the recognition of signs, including frequent blinking, that drivers are in danger of falling asleep at the wheel. Head and face positioning are also important cues of distraction.

Ongoing research at the centre now seeks to combine the detection, processing and grading of several different kinds of driver distraction in a single system.

“It has a huge impact on society,” said Karray, citing estimates that distracted drivers are to blame for up to 75 per cent of all traffic accidents worldwide.

Related Content

  • We need to talk about AVs
    October 15, 2021
    Will driverless vehicles lead to more deaths and destroy more lives than their manual counterparts? Transport writer Colin Sowman argues that they will
  • ITS asset management matters
    April 26, 2013
    Maintenance of on-road ITS kit needs to become more sophisticated; while new technologies can deliver better road maintenance. David Crawford investigates both sides of the issue "Good information is key to effective ITS asset maintenance,” says Ian Routledge of the Ian Routledge Consultancy (IRC), whose Imtrac (Information Management for TRAffic Control) system is poised for European expansion. Developed as an ‘intelligent filing cabinet’ for storing information about on-road equipment, the online database
  • Bus safe turn alert system warns distracted pedestrians
    March 19, 2015
    A new pilot program recently launched by South-eastern Pennsylvania Transportation Authority (SEPTA) will audibly warn pedestrians in the vicinity of a bus when the vehicle is making a turn. The Safe Turn Alert System pilot is an extension of the Authority's distracted commuter awareness program and designed to warn pedestrians, specifically those engrossed in phone calls, text messages and music that the bus is turning. Protran's Safe Turn Alert Systems have been installed in 12 SEPTA buses for the pilot p
  • ITS European Congress: safer and cleaner mobility
    August 6, 2019
    Smart mobility and the increasing digitalisation of transport were among the main themes of this year’s ITS European Congress in the Netherlands. Ben Spencer picks some highlights from conference sessions which considered possible future developments Navigating between the Evoluon conference centre - a former science museum that resembles a giant-sized UFO - and an automotive campus, there was a lot to see at the 13th ITS European Congress in Brainport, Eindhoven. Organised by Ertico – ITS Europe and th