New software could detect when people text and drive

Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.
September 20, 2017 Read time: 2 mins
Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.


Fakhri Karray, an electrical and computer engineering professor and director of the Centre for Pattern Analysis and Machine Intelligence (CPAMI) at Waterloo, said that information could be used to improve road safety by warning or alerting drivers when they are dangerously distracted. As advanced self-driving features are increasingly added to conventional cars, he said, signs of serious driver distraction could be employed to trigger protective measures.

“The car could actually take over driving if there was imminent danger, even for a short while, in order to avoid crashes,” said Karray.

Algorithms at the heart of the technology were trained using machine-learning techniques to recognise actions such as texting, talking on a cellphone or reaching into the backseat to retrieve something. The seriousness of the action is assessed based on duration and other factors.

That work builds on extensive previous research at CPAMI on the recognition of signs, including frequent blinking, that drivers are in danger of falling asleep at the wheel. Head and face positioning are also important cues of distraction.

Ongoing research at the centre now seeks to combine the detection, processing and grading of several different kinds of driver distraction in a single system.

“It has a huge impact on society,” said Karray, citing estimates that distracted drivers are to blame for up to 75 per cent of all traffic accidents worldwide.

Related Content

  • When caring about sharing is good business for US automakers
    October 28, 2015
    Although car-sharing and ride-sharing could drastically reduce car sales, David Crawford finds some US automakers are keen to participate in the sharing economy. Growing consumer interest in car- and ride-sharing, as opposed to outright ownership, and ride-sharer Uber’s recently stated intention to make its brand competitive with ownership on cost, are making the major US automotive manufacturers think seriously about their future sales prospects. Some have already begun exploring ways of entering the field
    Read More
  • Jaguar Land Rover to begin real-world tests of CAV technologies
    July 18, 2016
    Jaguar Land Rover plans to create a fleet of more than 100 research vehicles over the next four years, to develop and test a wide range of connected and autonomous vehicle (CAV) technologies. The first of these research cars will be driven on a new 41 mile test route on UK motorways and urban roads around Coventry and Solihull later this year. The initial tests will involve vehicle-to-vehicle and vehicle-to-infrastructure communications technologies that will allow cars to talk to each other and roadsid
    Read More
  • eCall mandatory in cars from 2015
    June 14, 2013
    The European Commission has adopted two proposals to ensure that, from October 2015, all new models of passenger cars and light duty vehicles will have to be fitted with 112 eCall, enabling them to automatically call emergency services in case of a serious crash. eCall is activated automatically as soon as in-vehicle sensors detect a serious crash. Once set off, the system dials the European emergency number 112, establishes a telephone link to the appropriate emergency call centre and sends details of the
    Read More
  • Transportation infrastructure technology continues its advance
    July 17, 2012
    It is now 20 years since publication of the Strategic Plan for Intelligent Vehicle Highway Systems. A select group of luminary figures of the ITS industry give their assessment of progress to date This year the IVHS Strategic Plan turns 20, signaling the graduation of the field of Intelligent Transportation Systems from its tumultuous teens to young adulthood. After two decades tethered by the cords of youth and protected by the strict control of adult institutions, ITS has reached a turning point. Its y
    Read More

Highlighted Content