Skip to main content

Sony's AI sensors in Rome smart city trial

Smart city project run by Envision will use Sony's IMX500 image sensors with AI processing
By Adam Hill May 28, 2021 Read time: 3 mins
Sony's IMX500 image sensors are placed in Envision's smart tips on traffic lights in Rome’s city centre

Envision is running smart city trials in Rome, using Sony image sensors, to cut the city’s transport-related emissions.

The three projects, due to start in early June, aim to make parking easier, reduce accidents at pedestrian crossings and minimise crowding on the Italian capital's buses.

Sony Europe's IMX500 sensor, which the company says is the first to integrate an AI processing functionality, is at the heart of the trials.

Two of the sensors are installed by TTM Group in Envision's smart tips (pictured), which have been put on top of some traffic lights in Rome’s city centre.

The sensors scan roads and parking spaces, sending real-time data elaborated by neural networks on available parking spaces as well as on the number of people waiting at bus stops, entering or leaving a bus, and waiting to cross - or actually crossing - the road.

A neural network was trained to identify all these factors during a preliminary phase of the trial.

Sony insists that no images are stored, or leave the sensor, thus satisfying privacy requirements. 

The company says this allows the city to reduce the bandwidth required, to scale it easily using existing networks, and to cut power and communication costs. 

Drivers will be alerted via a smartphone app and directed to an empty parking space closest to their destination. 

The location data is streamed in real time through the smart tip, then processed by Sony's sensor and sent to Envision's cloud software platform. The coordinates of the parking space’s location are overlaid on a map displayed on the app.

Rome's authorities believe that traffic caused by drivers cruising the streets to park is a key contributor to congestion, and this trial will aim to assess the scale of the problem.

When it comes to pedestrian safety, the neural network system detects that a zebra crossing is in use and low-latency smart lighting on the road will make pedestrians more visible, alerting drivers to their presence.

The length of bus stop queues will also be processed by the sensor in the smart tip through the neural network and sent to the Envision software platform.

This is aggregated and made available to bus network operators, so that planning and scheduling can be adjusted to avoid vehicles packed with riders.

“This is a clear and concrete example where Sony’s smart vision solution can serve our customer’s purpose while respecting people’s privacy," says Antonio Avitabile, MD of corporate alliance and investment at Sony.

“We have a vision of achieving more sustainable and liveable cities, and through the IMX500 scalable platform we can substantially accelerate this process.”

The project with the City of Rome also involves Mobilità Roma and lighting specialist Citelum, which is responsible for putting the smart tips into the streetlights.

For more information on companies in this article

Related Content

  • EasyMile resorts to AVs in Belgium
    October 14, 2022
    Company will provide unmanned shuttle service at Terhills complex in Flanders
  • Point Grey introduces new Blackfly and Grasshopper cameras
    March 18, 2014
    Point Grey’s latest cameras include the Blackfly ultra-compact PoE GigE vision camera and the 2.3 megapixel global shutter CMOS Grasshopper3 USB3 vision camera. The Blackfly BFLY-PGE-12A2 camera utilises global shutter CMOS technology to capture crisp, distortion-free images of objects in motion, for applications such as factory automation or open road tolling. The new Aptina AR0134 1.2 megapixel CMOS image sensor is capable of capturing images at 50 FPS and uses Aptina’s latest 3.75micron global shutter
  • AVT expands Manta camera range
    December 19, 2014
    Allied Vision has introduced two new models to its best-selling camera family, Manta. The Manta G-235 features Sony’s new IMX174 CMOS global shutter sensor and provides outstanding sensitivity, while the Manta G-505 delivers high frame rates at 5 Megapixel resolution.
  • Cepton and Belam boost railway safety
    September 28, 2021
    Cepton says the system has achieved an accuracy of over 99.9% in obstacle detection