Skip to main content

'Phantom’ menace endangers AV passengers, says study 

Projecting a ‘phantom’ image on the road can cause a semi-autonomous vehicle to brake suddenly and endanger passengers, according to a new study. 
By Ben Spencer February 20, 2020 Read time: 2 mins
BGU demonstrates how a phantom image can put passengers in an AV in danger (Source: © Haiyin | Dreamstime.com)

Researchers at Israel’s Ben Gurion University (BGU) say this is because advanced driver assistance systems (ADAS) in semi- or fully-autonomous vehicles (AVs) consider these depthless projections as real objects. 

PhD student Ben Nassi says: “This is not a bug. This is not the result of poor code implementation. This is a fundamental flaw in object detectors that essentially use feature matching for detecting visual objects and were not trained to distinguish between real and fake objects. This type of attack is currently not taken into consideration by the automobile industry.”

The ‘Phantom of the ADAS’ project also showed that attackers can fool a driving assistance system into believing fake road signs are real by distinguishing phantoms for 125 milliseconds in advertisements presented on digital billboards near roads.

He says a shortage of vehicular communication systems which connect cars to each other and the surrounding infrastructure is creating a “validation gap”, which prevents AVs from validating their virtual perception with a third party. 

More alarmingly, Nassi warns that remote attacks do not need to be carried out by skilled hackers who exploit the validation gap as the project demonstrated how such an attack can be carried out by projecting a phantom road sign from a drone. 

BGU researchers are now developing a convolutional neural network model that analyses a detected object’s contextual, surface and reflected light, which is capable of detecting phantoms with high accuracy.

For more information on companies in this article

Related Content

  • Oxbotica 'deepfakes' are teaching AVs
    June 29, 2020
    Autonomous vehicle (AV) software specialist Oxbotica is using 'deepfake' technology to develop cars for future deployment - thus minimising the need for testing on roads.
  • Artificial Intelligence applications for commercial vehicle operations
    December 28, 2021
    The combination of machine learning, deep neural networks and computer vision provides opportunities to address in new ways an increasing range of functions that are a part of commercial vehicle operations. Here, IRD’s Rish Malhotra details how.
  • Lidar: beginning to see the light
    March 14, 2022
    Lidar feels like a technology whose time has come – but why now? Adam Hill talks to manufacturers, vendors and system integrators in the sector to assess the state of play and to find out what comes next
  • Avoiding the call of the wild
    June 29, 2018
    Hitting an animal on a rural road can be fatal for all parties involved – but detecting and avoiding them requires clever technology. Andrew Williams carefully scans the horizon for details. Wildlife-vehicle collisions are an ever-present threat in rural areas around the world, and there is certainly nothing funny about suddenly finding an angry moose in your headlights on a sharp bend. A variety of detection and avoidance systems are currently in use or under development to help prevent your vehicle being