Skip to main content

Oxbotica 'deepfakes' are teaching AVs

Autonomous vehicle (AV) software specialist Oxbotica is using 'deepfake' technology to develop cars for future deployment - thus minimising the need for testing on roads.
By Adam Hill June 29, 2020 Read time: 2 mins
Oxbotica AI uses colour coding to generate fake images and synthesise different markings onto the road

Deepfaking uses deep learning artificial intelligence (AI) to generate fake photo-realistic images "to test countless scenarios".

Oxbotica can generate thousands of these in minutes, allowing it to change weather, cars, buildings and time of day - thus exposing AVs to "near infinite variations of the same road scene" without the need for real-world testing. 

While deepfake techniques have been used to mislead, shock and scam by realistically doctoring video footage to make it seem as though someone has said or done something they have not, the company uses it to reproduce scenes in adverse conditions - even putting rain water on lenses - or to confront vehicles with rare occurrences.

Oxbotica already users gamers in its R&D and believes that deepfake algorithms can help make AVs safer. 

“Using deepfakes is an incredible opportunity for us to increase the speed and efficiency of safely bringing autonomy to any vehicle in any environment," said Paul Newman, co-founder and CTO at Oxbotica.

"What we’re really doing here is training our AI to produce a syllabus for other AIs to learn from. It’s the equivalent of giving someone a fishing rod rather than a fish. It offers remarkable scaling opportunities."

He suggests there is no substitute for real-world testing but suggests that the AV sector has become concerned with the number of miles travelled "as a synonym for safety". 

"And yet, you cannot guarantee the vehicle will confront every eventuality, you’re relying on chance encounter," he says.
 
Oxbotica says the technology can reverse road signage or 'class switch' - which is where an object such as a tree is replaced by another, such as a building - or change the lighting of an image to mimic different times of the day or year.

The company says: "The data is generated by an advanced teaching cycle made up of two co-evolving AIs, one is attempting to create ever more convincing fake images while the other tries to detect which are real and which have been reproduced."

Engineers have designed a feedback mechanism which means both AIs compete to outsmart each other. 

"Over time, the detection mechanism will become unable to spot the difference, which means the deepfake AI module is ready to be used to generate data to teach other AIs."

For more information on companies in this article

Related Content

  • Debating road user charging systems
    January 26, 2012
    Are pre-launch trials of charging systems the way to improve public acceptance? Or is the real key a more robust political attitude? Here, leading system suppliers discuss the issue. The use of distance-based Road User Charging (RUC) is now well established, at least for heavy goods vehicles on strategic roads. However demand management for all vehicles, whether a distance-based charge or some form of cordon scheme, has yet to make significant progress. This is in spite of the logic and equity of RUC being
  • US incident management needs national standardisation
    January 26, 2012
    I-95 Corridor Coalition's Tom Martin discusses the state of the art in incident management and what visitors to this year's ITS World Congress can expect of the first ever Emergency Responder-Incident Management Day. Developments in incident management are driven in the main by need. A bald statement, and one which holds no surprises, it nevertheless quantifies the evolutionary process within the I-95 Corridor Coalition over the last decade and more. Spread over 16 states from Maine to Florida, the Coalitio
  • Redflex: ‘Consistency of enforcement will drive compliance’
    August 7, 2020
    Mark Talbot, CEO of Redflex Holdings, puts himself in the ITS International hotseat to answer questions about leveraging technology, MaaS changes and new areas of business
  • America fires V2V starting gun
    April 7, 2014
    Leo McCloskey, ITS America’s senior vice president for Technical Programs, talks to Jason Barnes about what the recent NHTSA ruling on light vehicle connectivity means for cooperative infrastructures in North America. In early February the US Department of Transportation’s (USDOT’s) National Highway Traffic Safety Administration (NHTSA) announced it had decided to start taking steps to enable Vehicle-to-Vehicle (V2V) communication technology for light vehicles. In so doing, the many safety-related applicati