Skip to main content

Cost benefit analysis ‘can’t be carried out with a cookbook’

There is far more to working out the worth of a project than simply filling in a few headings on a spreadsheet. David Crawford surveys some recent thinking from the US and Canada. Cost benefit analysis (CBA) “can’t be carried out with a cookbook”, warns US analyst Professor Robert J Brent. “ You can’t just get out a spreadsheet and fill in the data for all the headings. Each transport CBA should have something that is distinctive, in terms of location (for example, for a rural area), types of user
June 25, 2018 Read time: 7 mins
The Nissan Leaf is one model available at a discount under Québec’s Roulez-électrique programme

There is far more to working out the worth of a project than simply filling in a few headings on a spreadsheet. David Crawford surveys some recent thinking from the US and Canada.

Cost benefit analysis (CBA) “can’t be carried out with a cookbook”, warns US analyst Professor Robert J Brent. “ You can’t just get out a spreadsheet and fill in the data for all the headings. Each transport CBA should have something that is distinctive, in terms of location (for example, for a rural area), types of user (commuters, the elderly) or the environment.” CBA is not simply an evaluation technique, argues the professor of economics at New York’s Fordham University in his recently-published Advanced Introduction to Cost Benefit Analysis. It can and should take more than one form – reflecting considerations of, for example, economic efficiency, financial issues or social worth.

Economic efficiency

One case he instances in the North American transportation sector concerned the viability of US bus services running in Washington, DC. Another, in Canada, involved the province of Québec’s Roulez-électrique (Drive Electric) programme. On the former, he cited a CBA for the continuation of a weekday bus service which found that, even without taking account of reduced levels of traffic accidents and air pollution benefits, total benefits exceeded total costs. Maintaining the service, which was subject to review, proved to give passengers US$975m worth of annual benefits, while those for motorists totalled US$68m - for example from reduced congestion. The US$228m public subsidy that was required to cover a financial shortfall was therefore “clearly justified on grounds of economic efficiency”.

Social worth

Brent goes on to present an evaluation of Québec’s Roulez-électrique as an example of a socially- worthwhile CBA. The province is one of the world’s largest producers of hydroelectric power, with a political commitment to exploiting this for green transport . With a total capacity of 36,643 MW, the government-owned 195 Hydro-Québec produces over 99% of its power from water and exports excess capacity to neighbouring Canadian provinces and US states. It also supports a charging network that is capable of supplying the power needs of one million Canadian electric vehicles (EVs) – a political target set to boost the current tally of around 23,000. Hydro-Québec spokesperson Louis-Olivier Batty told ITS International that the desired figure would equate to about 2% of Québec’s electricity consumption: “We have all the resources necessary to support the electrification of a lot more private vehicles as well as supplying power for public transport.” Alongside Roulez-électrique, which helps EV purchase by granting subsidies, the parallel Branché au travail (Plug at work) programme supports the installation of electric charging points at workplaces.

Environmental discount

The starting point for the current initiatives is the fact that, in 2012, the largest percentage of greenhouse gas emissions in Québec – 44.7% – came from transportation, having grown by 25.7% since 1990. Meanwhile, those emissions arising from other sectors fell by 24.3%. Now, close to half of all the plug-in electric and hybrid passenger cars sold in Canada are going to buyers in Québec. Under Roulez-électrique, the buyer of, for example, a model year 2015-17 Nissan Leaf is entitled to a discount of up to CN$8,000 (US$6,400). The Québec government cites the cost of a driver installing a 240 volt EV charging system at a home, that does not have an adequate and code compliant power outlet, at between CN$600 (US$480) and CN$1,300 (US$1,040) before taxes. The user can apply for a refund. Charging stations are available from dealers, distributors, superstores or directly from manufacturers.

Main saving

Brent bases a CBA calculation for Roulez-électrique on a sample exercise by Mercier, X; Lanoie, P; and Leroux, J: Costs and benefits of Quebec’s Drive Electric program (2015), which shows a net social benefit of CN$ 0.173m (US$0.138m). The main saving is benefit in the form of fuel economy (CN$1.759m = US$1.407m). On top of this, the calculation goes into sufficient detail to allow for the lack of need for oil changes in running EVs. At CN$0.063 million (US$0.050 million), Brent told ITS International: “The savings on these are not as sizeable, but you still need to establish the fact.” Against these, costs - including administration and rebates - total CN$1.653m (US$1.322m). The figure for electricity is CN$0.018m (US$ 0.014m) - a figure reflecting an abundance of hydro-electric power. Around three-quarters of the costs (CN$1.221m, US$977m) reflect the impact of CN$6.2m (US$4.9m) worth of subsidies, which generate a 20% marginal excess burden - the figure cited, representing a “deadweight” loss. Brent told ITS International: “If the perspective had been just of the government, and not society as a whole, all the $6.2 million subsidy would be considered a cost.” Under the parallel Branché au travail, employers can gain assistance worth up to CN$25,000 (US$20,000) for acquiring and installing a new workplace charging station. This has to remain operational for at least three years and be available to employees free of charge.

Difficult to predict

Outlining the issues inherent in developing CBAs for transport initiatives, Brent noted: “Estimating costs and benefits of environmental effects is extremely problematic, as these are difficult to predict with certainty over very long periods of time. But the job has to be done.” Again, he argued, it is crucial to decide whether to consider the effects on other countries or to take just a nationalistic perspective. The Mercier et al. study took a global one, “which is one reason why their analysis is impressive”. Further, he added: “The term ‘social’ - meaning the effect on everyone who is affected - is a standard part of a transport CBA. But, in terms of economic efficiency and income distribution effects, it is not well understood in the transport field. For example, it is almost universal for a transport CBA to carry out a financial and efficiency calculation and leave the formal calculations at that. The evaluation then adds on some comments about who gains and who loses (for example, in terms of the average incomes of bus users). But no joint efficiency and distribution calculation follows. The solution is to combine efficiency with equity calculations by using distribution weights. But in practice this almost never takes place because economists generally think that distribution weights are ‘unscientific’.”

No alternative

In the end, Brent suggests that there is no real alternative to using CBAs to evaluate transport policies. “At the same time, almost every evaluation involves the need to value something new – for example an intangible effect on culture, tradition or social cohesion,” he concludes. “As a way of thinking, CBA provides insight into the type of new data that will help ensure that the essence of an intervention is captured by the evaluation.”

The price of public bus services

Professor Robert J Brent’s research has identified a number of key factors, in addition to lower accident and emissions levels, that a private operator, acting in its own interests, would not consider in costing a service - but that are critical in justifying a public subsidy. These include levels of traffic congestion; costs of road and parking infrastructure; costs of car ownership for those forced to drive if there is no bus; and energy consumption. These can all, however, contribute to an economic efficiency CBA. Resources are more efficiently allocated and society is better off with the continuation of the service as total benefits exceed total costs. Bus services in most regions typically make losses and so would fail a purely financial CBA. But including external benefits, for example in reduced congestion, makes for an economic one that give a positive verdict for public subsidies.

Related Content

  • July 19, 2018
    Cost benefit: Toronto retimings tame traffic trauma
    Canada’s largest city reckons that it is saving its taxpayers’ money simply by altering the way traffic lights work. David Crawford reviews Toronto’s ambitious plans to ease congestion Toronto, Canada’s largest metropolis (and the fourth largest in North America), has saved its residents CAN$53 (US$42.4) for every CAN$1 (US$0.80) spent over a 2012-2016 traffic signal retiming programme, according to figures released by its Transportation Services Division. The programme covered 1,275 signals (the city’s
  • July 11, 2018
    Cost benefit: Toronto retimings tame traffic trauma
    Canada’s largest city reckons that it is saving its taxpayers’ money simply by altering the way traffic lights work. David Crawford reviews Toronto’s ambitious plans to ease congestion. Toronto, Canada’s largest metropolis (and the fourth largest in North America), has saved its residents CAN$53 (US$42.4) for every CAN$1 (US$0.80) spent over a 2012-2016 traffic signal retiming programme, according to figures released by its Transportation Services Division. The programme covered 1,275 signals (the city’s to
  • October 3, 2018
    Carrots are proving cost-effective in Netherlands
    There are lessons to be learned from congestion avoidance schemes in the Netherlands. David Crawford welcomes some new thinking in road pricing. Highway operators worldwide are being urged to learn from Dutch experience in using financial carrots rather than sticks to encourage drivers to avoid contributing to congestion. A Netherlands/UK group makes a convincing cost/benefit case in a new global survey of road pricing technologies, economics and acceptability. Representing the Rijkswaterstaat section of
  • August 21, 2017
    Cost benefit goes under the microscope
    Conventional cost benefit analysis (CBA) of plans for urban smart mobility initiatives needs serious rethinking, according to a recently-completed European study. The three-year Evidence Project (the Project) emerged in response to concerns about the availability and quality of documented research – including CBA – required to prove that investment in sustainable urban mobility plans (SUMPs) can be economically beneficial. Covering 22 sectors ranging from electric vehicles to shared spaces, the Project clai