Skip to main content

Allied Vision and TORC Robotics help blind driver ‘see’

TORC Robotics has partnered with the Robotics and Mechanisms Laboratory (RoMeLa) at the Virginia Polytechnic Institute and State University (Virginia Tech) with the aim of developing vehicles for the next generation of National Federation of the Blind (NFB) Blind Driver Challenge vehicles. The NFB developed the Blind Driver Challenge which calls upon developers and innovators to create interface technologies to allow those who are blind to drive a car independently. Held at the Daytona Speedway as a pre
May 22, 2015 Read time: 3 mins
TORC Robotics has partnered with the Robotics and Mechanisms Laboratory (RoMeLa) at the Virginia Polytechnic Institute and State University (5593 Virginia Tech) with the aim of developing vehicles for the next generation of National Federation of the Blind (NFB) Blind Driver Challenge vehicles.

The NFB developed the Blind Driver Challenge which calls upon developers and innovators to create interface technologies to allow those who are blind to drive a car independently.  Held at the Daytona Speedway as a pre-race event for the annual Rolex 24 sports car endurance race, a blind driver was to independently drive the vehicle down the main straight onto the road course.  

Using a crossover SUV, TORC implemented its ByWire drive-by-wire conversion modules, SafeStop wireless emergency stop system, and PowerHub distribution modules on the vehicle.  Drive-by-wire gives a driver electronic control of a vehicle.  The premise comes from the fly-by-wire system, where an aircraft’s controls produce electronic signals which are read and put through computing systems connected to actuators that control the surfaces of the wings and tail.

Jesse Hurdus, TORC’s project manager for this event, stated, “Cars are much further behind in taking this step.  In order to have an autonomous vehicle, you need to have it so a computer can control the throttle, transmission, and braking systems.  This is drive-by-wire”.

The team also used light detection and ranging (LIDAR) which measures distance by emitting a laser pulse and analysing the reflected light to determine the obstacles a driver has to drive around.  However, LIDAR has difficulty with classifying obstacles and differentiating objects such as vegetation from other solid objects, which is where Allied Vision’s Prosilica GC1290C camera provided the solution.

TORC used the camera to help overcome the challenges LIDAR presents, by taking sensor data and feeding it into the software to provide an understanding on what is around the vehicle and detecting lane markings. The information is fed back to the autonomous system and provides input to the blind driver so that he or she can keep the vehicle centred and within the lane.  

The blind driver wears special DriveGrip gloves and sits on a SpeedStrip padded insert on the driver’s seat.  The gloves contain small vibrating motors on top of each finger which help relay steering information from the autonomous system.  The padding on the driver’s seat also contains vibrating motors stretching along the driver’s legs and back which relay the vehicle’s speed information and vibrate to tell the driver to accelerate or brake. Vibrations in the gloves to signal the direction the car needs to be turned.

While the focus of TORC’s systems was specifically for the Challenge, they can be potentially used for future solutions.  Hurdus concluded, “This was an exploratory effort to see how we could use the cameras to achieve the goal.  A person blind from birth was able to drive a vehicle outfitted with sensor technology to give him an understanding of the environment generated by a combination of Allied Vision’s cameras, LIDAR systems, and GPS localisation systems.  The fusion of all this data was able to give this person the ability to ‘see’ the environment as a person would be able to see through their own eyes.”

Related Content

  • February 28, 2013
    Driverless vehicles just around the corner?
    umors that self-driving taxis are about to hit the streets of Las Vegas have turned out to be untrue… but the age of the driverless vehicle is only just around the corner, as Pete Goldin finds out. From Herbie the Love Bug to Knight Rider to the cast of the Pixar film Cars, the autono­mous auto has long been a beloved icon in the entertainment industry. But how close is the fiction to fact? The general public might be surprised to find out just how soon autonomous vehicles could be driving on our roadways.
  • August 23, 2016
    Mobileye and Delphi partner on SAE Level 4/5 automated driving solution
    Computer vision systems specialist Mobileye and Delphi Automotive, which specialises in automated driving software, are to collaborate to develop a complete SAE Level 4/5 automated driving solution. The solution will be based on key technologies from each company, including Mobileye's EyeQ 4/5 system on a chip (SoC) with sensor signal processing, fusion, world view generation and Road Experience Management (REM) system, which will be used for real time mapping and vehicle localisation. Delphi will inc
  • March 23, 2017
    Two thousand people take part in Australia’s driverless bus trial
    More than 2,000 people have now taken part in Australia’s first driverless bus trial, the RAC Intellibus, since its launch by automobile club on public roads in South Perth, Western Australia. RAC general manager for public policy, Anne Still, said the trial was one of the most progressive in the world and had generated a lot of public interest, with more than 6,000 people registered to take part in the trial. So far, the RAC Intellibus has completed 357 trips and travelled 1,050 kilometres. The fu
  • May 15, 2018
    VTT 's robot car now sees through fog
    VTT Technical Research Centre of Finland says it is one step closer to creating a safe automated vehicle through upgrades made to its Marilyn robot car. The vehicle can now see through foggy and snowy conditions, navigating without stopping. Additionally, VTT says, the car can see humans through fog and avoid accidents automatically. Marilyn now has light imaging, detection, and ranging (Lidar) mounted on its roof, which the company claims enables it to see wavelengths beyond the human senses.