New software could detect when people text and drive

Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.
September 20, 2017 Read time: 2 mins
Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.


Fakhri Karray, an electrical and computer engineering professor and director of the Centre for Pattern Analysis and Machine Intelligence (CPAMI) at Waterloo, said that information could be used to improve road safety by warning or alerting drivers when they are dangerously distracted. As advanced self-driving features are increasingly added to conventional cars, he said, signs of serious driver distraction could be employed to trigger protective measures.

“The car could actually take over driving if there was imminent danger, even for a short while, in order to avoid crashes,” said Karray.

Algorithms at the heart of the technology were trained using machine-learning techniques to recognise actions such as texting, talking on a cellphone or reaching into the backseat to retrieve something. The seriousness of the action is assessed based on duration and other factors.

That work builds on extensive previous research at CPAMI on the recognition of signs, including frequent blinking, that drivers are in danger of falling asleep at the wheel. Head and face positioning are also important cues of distraction.

Ongoing research at the centre now seeks to combine the detection, processing and grading of several different kinds of driver distraction in a single system.

“It has a huge impact on society,” said Karray, citing estimates that distracted drivers are to blame for up to 75 per cent of all traffic accidents worldwide.

Related Content

  • Cooperative infrastructure systems waiting for the go ahead
    February 3, 2012
    Despite much research and technological promise, progress towards cooperative infrastructure system deployment is still slow. Here, Robert Cone and John Miles take a considered look at how and when it might come about. From a systems engineering viewpoint it looks logical and inevitable that vehicles should be communicating between themselves and with the road infrastructure. But seen from a business viewpoint the case is not proven.
    Read More
  • Driverless-vehicle options now include scooters
    November 9, 2016
    Researchers have developed an autonomous mobility scooter which could, in principle, use a scooter to get down the hall and through the lobby of an apartment building, take a golf cart across the building’s parking lot, and pick up an autonomous car on the public roads.
    Read More
  • Dutch launch intelligent cycle
    December 17, 2014
    The Netherlands on Monday launched its first-ever ‘intelligent bicycle, fitted with an array of electronic devices to help bring down the high accident rate among elderly cyclists in the cycle-mad country. Developed for the government by the Netherlands Organisation for Applied Scientific Research (TNO), the intelligent bicycle prototype runs on electricity, and sports a forward-looking radar mounted below the handlebars and a camera in the rear mudguard.
    Read More
  • Driverless vehicles will cause changes in society
    May 31, 2013
    Paul Godsmark gives his views on what the advent of autonomous vehicles would mean for the wider society. Further to your article ‘Driver not required…’ in the Jan/Feb edition of ITS International which gave some great background to autonomous road vehicle (ARVs), I feel that the bigger picture is needed to aid understanding. There is a ‘technology freight train’ heading our way that is going to transform our roadways but we don’t seem to be aware of it and, therefore, are in no hurry to react.
    Read More

Highlighted Content