Skip to main content

Sony's AI sensors in Rome smart city trial

Smart city project run by Envision will use Sony's IMX500 image sensors with AI processing
By Adam Hill May 28, 2021 Read time: 3 mins
Sony's IMX500 image sensors are placed in Envision's smart tips on traffic lights in Rome’s city centre

Envision is running smart city trials in Rome, using Sony image sensors, to cut the city’s transport-related emissions.

The three projects, due to start in early June, aim to make parking easier, reduce accidents at pedestrian crossings and minimise crowding on the Italian capital's buses.

Sony Europe's IMX500 sensor, which the company says is the first to integrate an AI processing functionality, is at the heart of the trials.

Two of the sensors are installed by TTM Group in Envision's smart tips (pictured), which have been put on top of some traffic lights in Rome’s city centre.

The sensors scan roads and parking spaces, sending real-time data elaborated by neural networks on available parking spaces as well as on the number of people waiting at bus stops, entering or leaving a bus, and waiting to cross - or actually crossing - the road.

A neural network was trained to identify all these factors during a preliminary phase of the trial.

Sony insists that no images are stored, or leave the sensor, thus satisfying privacy requirements. 

The company says this allows the city to reduce the bandwidth required, to scale it easily using existing networks, and to cut power and communication costs. 

Drivers will be alerted via a smartphone app and directed to an empty parking space closest to their destination. 

The location data is streamed in real time through the smart tip, then processed by Sony's sensor and sent to Envision's cloud software platform. The coordinates of the parking space’s location are overlaid on a map displayed on the app.

Rome's authorities believe that traffic caused by drivers cruising the streets to park is a key contributor to congestion, and this trial will aim to assess the scale of the problem.

When it comes to pedestrian safety, the neural network system detects that a zebra crossing is in use and low-latency smart lighting on the road will make pedestrians more visible, alerting drivers to their presence.

The length of bus stop queues will also be processed by the sensor in the smart tip through the neural network and sent to the Envision software platform.

This is aggregated and made available to bus network operators, so that planning and scheduling can be adjusted to avoid vehicles packed with riders.

“This is a clear and concrete example where Sony’s smart vision solution can serve our customer’s purpose while respecting people’s privacy," says Antonio Avitabile, MD of corporate alliance and investment at Sony.

“We have a vision of achieving more sustainable and liveable cities, and through the IMX500 scalable platform we can substantially accelerate this process.”

The project with the City of Rome also involves Mobilità Roma and lighting specialist Citelum, which is responsible for putting the smart tips into the streetlights.

For more information on companies in this article

Related Content

  • Machine vision develops closer traffic ties
    January 11, 2013
    Specifiers and buyers of camera technology in the transportation sector know what they need and are seeking innovative solutions. Over the following pages, Jason Barnes examines the latest developments with experts on machine vision technology. Transplanting the very high-performance camera technology used in machine vision from tightly controlled production management environments into those where highly variable conditions are common requires some careful thinking and not a little additional effort. Mach
  • Bike lane enforcement is next stop for Hayden AI
    November 7, 2023
    New solution aims to reduce illegal parking in bike lanes and improve cyclist safety
  • VivaCity captures simple zebra data
    January 23, 2023
    Sensors will help establish VRU/driver behaviour changes at 'non-prescribed' crossings
  • Harnessing the strengths of CMOS for ITS applications
    January 24, 2017
    Sony’s Arnaud Destruels explains the benefits of CMOS sensors for ITS applications. In the transport sector roadside, trackside and platform cameras were devices for viewing and assessing a situation while individual sensors did all the clever stuff like traffic counting, speed calculation, queue lengths, signal status and so on. Well, not any more.