Skip to main content

Oxbotica 'deepfakes' are teaching AVs

Autonomous vehicle (AV) software specialist Oxbotica is using 'deepfake' technology to develop cars for future deployment - thus minimising the need for testing on roads.
By Adam Hill June 29, 2020 Read time: 2 mins
Oxbotica AI uses colour coding to generate fake images and synthesise different markings onto the road

Deepfaking uses deep learning artificial intelligence (AI) to generate fake photo-realistic images "to test countless scenarios".

Oxbotica can generate thousands of these in minutes, allowing it to change weather, cars, buildings and time of day - thus exposing AVs to "near infinite variations of the same road scene" without the need for real-world testing. 

While deepfake techniques have been used to mislead, shock and scam by realistically doctoring video footage to make it seem as though someone has said or done something they have not, the company uses it to reproduce scenes in adverse conditions - even putting rain water on lenses - or to confront vehicles with rare occurrences.

Oxbotica already users gamers in its R&D and believes that deepfake algorithms can help make AVs safer. 

“Using deepfakes is an incredible opportunity for us to increase the speed and efficiency of safely bringing autonomy to any vehicle in any environment," said Paul Newman, co-founder and CTO at Oxbotica.

"What we’re really doing here is training our AI to produce a syllabus for other AIs to learn from. It’s the equivalent of giving someone a fishing rod rather than a fish. It offers remarkable scaling opportunities."

He suggests there is no substitute for real-world testing but suggests that the AV sector has become concerned with the number of miles travelled "as a synonym for safety". 

"And yet, you cannot guarantee the vehicle will confront every eventuality, you’re relying on chance encounter," he says.
 
Oxbotica says the technology can reverse road signage or 'class switch' - which is where an object such as a tree is replaced by another, such as a building - or change the lighting of an image to mimic different times of the day or year.

The company says: "The data is generated by an advanced teaching cycle made up of two co-evolving AIs, one is attempting to create ever more convincing fake images while the other tries to detect which are real and which have been reproduced."

Engineers have designed a feedback mechanism which means both AIs compete to outsmart each other. 

"Over time, the detection mechanism will become unable to spot the difference, which means the deepfake AI module is ready to be used to generate data to teach other AIs."

For more information on companies in this article

Related Content

  • Driven consortium aims to trial AVs in London before Christmas
    November 28, 2018
    The Driven consortium, led by software provider Oxbotica, hopes to trial a fleet of autonomous vehicles (AV) in London before Christmas following successful ongoing tests in Oxford. The vehicles will map streets in the London Borough of Hounslow as part of the consortium’s plans to run a fully autonomous fleet between both cities in 2019. Oxbotica has equipped the vehicles with its autonomous software, radar, lidar sensors and onboard computers and cameras. The fleet will gather data on the contents of
  • The free and open internet is dead
    June 25, 2018
    A key US vote may have changed what internet service providers are allowed to charge and how they restrict content: Joe Dysart explains why this has consequences for ITS companies. While most people were rushing around last December, grabbing last-minute gifts for the holidays, the US Federal Communications Commission (FCC) voted to drive a stake into the heart of the free and open internet. In a majority vote, the agency killed ‘net neutrality’ - a policy that has prevented your regional internet service
  • Need for simpler urban tolling solutions
    January 10, 2013
    A common assumption, even amongst informed observers, is that there’s but a handful of urban charging schemes in operation around the world and scant prospect of that changing any time soon. Larger city-sized schemes such as Singapore, London and Stockholm come readily to mind but if we take a wider view and also consider urban access control and Low Emission Zones (LEZs) then the picture changes rather radically. There is a notable concentration of such schemes in Europe but worldwide the number is comfort
  • Seleta Reynolds: 'Set a vision, listen to your people & then get out of their way'
    September 12, 2022
    Los Angeles, host of the 2022 ITS World Congress, is a city where the only constant is change, says Seleta Reynolds of LA Metro. Adam Hill finds out about leadership, dream jobs and the 2028 Olympics...