New software could detect when people text and drive

Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.
September 20, 2017 Read time: 2 mins
Engineering researchers at Canada’s University of Waterloo are developing technology which can accurately determine when drivers are texting or engaged in other distracting activities. The system uses cameras and artificial intelligence (AI) to detect hand movements that deviate from normal driving behaviour and grades or classifies them in terms of possible safety threats.


Fakhri Karray, an electrical and computer engineering professor and director of the Centre for Pattern Analysis and Machine Intelligence (CPAMI) at Waterloo, said that information could be used to improve road safety by warning or alerting drivers when they are dangerously distracted. As advanced self-driving features are increasingly added to conventional cars, he said, signs of serious driver distraction could be employed to trigger protective measures.

“The car could actually take over driving if there was imminent danger, even for a short while, in order to avoid crashes,” said Karray.

Algorithms at the heart of the technology were trained using machine-learning techniques to recognise actions such as texting, talking on a cellphone or reaching into the backseat to retrieve something. The seriousness of the action is assessed based on duration and other factors.

That work builds on extensive previous research at CPAMI on the recognition of signs, including frequent blinking, that drivers are in danger of falling asleep at the wheel. Head and face positioning are also important cues of distraction.

Ongoing research at the centre now seeks to combine the detection, processing and grading of several different kinds of driver distraction in a single system.

“It has a huge impact on society,” said Karray, citing estimates that distracted drivers are to blame for up to 75 per cent of all traffic accidents worldwide.

Related Content

  • Getting C/AVs from pipedream to reality
    October 17, 2019
    The UK government has suggested that driverless cars could be on the roads by 2021. But designers and engineers are grappling with a number of difficult issues, muses Chris Hayhurst of MathWorks Earlier this year, the UK government made the bold statement that by 2021, driverless cars will be on the UK’s roads. But is this an achievable reality? Driverless technology already has its use cases on our roads, with levels of autonomy ranked on a scale. At one end of the spectrum, level 1 is defined by th
    Read More
  • ITSA’s Shailen Bhatt looks to the future
    March 6, 2018
    The new boss of ITS America is fizzing with ideas. Shailen Bhatt talks to Adam Hill about the need to rebrand the ITS industry, how technology can leverage tax dollars – and where the Star Wars universe fits in to his philosophy. Shailen Bhatt has a big job on his hands. The CEO and president of the Intelligent Transportation Society of America is the second to hold the post in two years following the resignation last July of his predecessor Regina Hopper. It has not been the easiest time for the
    Read More
  • Statistical improvement for short-term travel time predictions
    June 2, 2014
    Researchers at Imperial College in London have developed a generic three-stage short-term travel prediction model that promises to give greater accuracy under both normal and abnormal conditions. As travellers do not like the randomness of non-recurrent traffic congestion and delays, it is particularly useful for network managers to know how the ongoing traffic situation will develop when an atypical event occurs.
    Read More
  • Driver training saves lives, increases profits, reduces costs
    February 3, 2012
    An innovative UK Government initiative on work-related driver training has resulted in astonishing success, not only in terms of government objectives, but also in substantial cost-benefits for companies and public sector authorities participating in the scheme: they save lives and increase profits/reduce costs Here, we present an overview of the initiative and, overleaf, provide a detailed cost-benefit analysis which amply illustrates why it has been enthusiastically embraced by industry and the public sec
    Read More

Highlighted Content