The most important HSR news right now is the recent revelation on the LA Times, strategically made immediately after the state legislature had voted to appropriate the required money to begin construction, that the California HSR Authority had brushed off an offer from SNCF, which came with funding attached, to take over and build the project. SNCF’s offer would run trains through I-5 all the way instead of the chosen route vaguely along State Route 99, bypassing Bakersfield and Fresno.

Stephen Smith, who’s talked to the same sources who spoke with the LA Times, says that SNCF was interested in either I-5 or a greenfield alignment just west of SR 99 that would serve Bakersfield and Fresno with edge-of-urban area stations, though I-5 was “the only alignment… that private backers felt was financially viable.”

Although in 2009 SNCF submitted a document proposing to build the project along the chosen alignment, serving Bakersfield and Fresno at city-center stations, the document is stamped “Do not circulate outside government,” and the source says explicitly that the HSR Authority had pressured SNCF not to say anything about alignments, and more recently rejected its I-5 (or west-of-99) proposal out of hand. The HSR Authority responded, brushing off some of the article’s concerns and raising what is essentially FUD: HSR Authority Chair Dan Richard made sure to mention the manufactured controversy over the fact that SNCF had been forced by the Nazis to help ship Jews to extermination camps.

I do not have any access to sources, confidential or otherwise, but at least some analysis of this can be made from public information. The key cost numbers the LA Times provided are,

The I-5 route would have been the shortest, fastest and lowest-cost alignment, with a price tag of about $38 billion — sharply less than the rail authority’s current route, which has been estimated at various times to cost $34 billion, $43 billion, $98 billion and now $68 billion.

The problem: the cost of the Central Valley segment is a sufficiently small portion of the cost that it can’t possibly make the entire or even most of difference between $38 billion and the current price tag. It’s unclear to me what $38 billion should be compared to – 2010 dollars or year-of-expenditure dollars, and the Blended Plan ($68 billion YOE) or the full Phase 1 ($98 billion YOE) – but the lowest number, the Blended Plan in 2010 dollars, is $53 billion, $15 billion more than SNCF’s proposal. I have asked what exactly the comparable Authority number is and will update when I get an answer.

In contrast, the Initial Construction Segment, which includes a large majority of the Phase 1 Central Valley segment (though not the most difficult part, through Bakersfield) is $5.2 billion in 2010 dollars (see PDF-page 15 of the 2010 business plan); the actual money appropriated is just over $6 billion, but if we’re doing YOE numbers then we must compare $38 to $68 and then the difference doubles. Since the cost of construction along I-5, although lower than along the chosen route with its viaducts and grade separations, is nonzero, we get that a relatively small fraction of the cost difference, perhaps a quarter or a third, is attributable to this design choice.

So if it’s not just I-5, what is it, and what can we learn from this? I believe the results should if anything make the HSR Authority look even worse than it already does in light of this story and its lackluster response. This is because it means the entire amount of money required to build to SNCF’s specs but serve Bakersfield and Fresno, at edge-of-urban-area stations if the cities object to the noise of trains through downtown (which at least Fresno does not), is a small number of billions of dollars. This means that if service to those two cities was the true dealbreaker, the Authority could have asked SNCF to change the alignment back to the chosen route or a greenfield route just west of it, and then demanded that Fresno and Bakersfield pay for the difference.

Fresno had been hoping to use statewide HSR money to bundle its own project of grade-separating the freight tracks through the city along the Union Pacific right-of-way. The poor relationship between the HSR Authority and Union Pacific dashed the plans to use its right-of-way where it is superior to the BNSF alignment. That said, the threat of being left out of the network entirely could have induced it to come up with money for this on its own; the segment of the project through the Fresno area is $1-1.5 billion. A downtown station in Bakersfield is more difficult, especially if one gets from the Central Valley to the LA Basin via the Grapevine rather than via Palmdale, but in Bakersfield there are some complaints about the impacts that a downtown alignment would cause, and at any rate even I-5 would come close to serving the urban area.

In addition, portions of the cost savings that do not come from alignment choice have to be attributed to superior cost control. Part of the difference between American and rest-of-world construction costs has to come from more mundane issues such as proper supervision of contractors, since the difference is large and persistent and remains in place even after one controls for such issues as the percentage of the route that is in tunnel. (For example, recall that the Tohoku Shinkansen extension cost $4.6 billion for 82 km, of which a third is just one long tunnel and another sixth additional shorter tunnels).

The other lesson we can learn from this episode is political, regarding cost escalations and strategic misrepresentation. Too many political transit supporters downplay the issue. LightRailNow claims that a cost escalation that occurs before construction starts is not a cost escalation, but just a more accurate cost estimate; Robert Cruickshank did not quite say the same when the 2010 business plan for CAHSR revealed costs had doubled, but came close to it by describing the plan as more careful and thorough. In reality, large bombshell reports shortly after money has been obligated are a hallmark of secretive, untrustworthy planning, precisely the kind likeliest to lie about costs.

The main problem with megaprojects is not the dollar cost. In the grand scheme of things, a lot of them can generate enough social rate of return, and sometimes even a purely financial rate of return; at any rate, even when they are cost-ineffective, they are a small proportion of total GDP. The problem is getting politicians to vote for them. This means that issues such as institutional inertia are in play. It’s harder to get people to rescind money than to get them to vote against spending money.

If the primary cause of cost escalations is unforeseeable challenges, then we will see them come in timed with engineering developments, contract awards, and actual construction. If instead it is strategic misrepresentation, then they will be timed to come just after major political hurdles regarding funding: the passage of a referendum, legislative funding, an electoral victory by a supportive politician. The California HSR bombshells aren’t quite this clean, but they come a lot closer to the outright lying hypothesis.

The 2012 CAHSR business plan has some bombshell construction cost numbers: the headline number is $98 billion, leading to predictable complaints that the cost has run over by a factor of 3 over the original $33 billion budget of 2008. This is somewhat misleading since it includes inflation, but there’s still a factor-of-2 real cost overrun to investigate: in 2010 dollars the cost is $65 billion, as predicted by CARRD though with a somewhat different distribution of cost overrun among the various segments.

Some of it is scope creep that could be removed later via value engineering, and some is additional delays. The new plan assumes construction will take until 2033, vs. 2020 originally. The one point of light is that the initial construction segment (ICS) from Fresno to Bakersfield is still within budget, giving time to send the people involved in scope creep to early retirement and do the designs better. The biggest cost overruns are on the Peninsula and LA Basin segments, which are now up to $25 billion, about triple the original cost estimate. This already suggests that lack of money is what is causing costs to grow: just as it’s expensive to be poor, so is it expensive for an agency to have no money and drag construction over decades, in many segments.

But it’s not just the delays. The Peninsula blended plan includes many extra features, such as $1.5 billion for 80 km of electrification (in Auckland the same amount of electrification cost $80 million), $1 billion for 10 km of very tall and unnecessary viaducts through downtown San Jose, and $500 million $1.9 billion to tunnel under Millbrae (see update below) in order to preserve BART’s three tracks.

There’s scope creep and there’s scope creep. Sometimes, a project’s costs go up because new features are added that are useful (for example, converting a single-track diesel project into a dual-track electrified light rail, as was done on the LA Blue Line), or that are necessary but were glossed over initially in order to keep cost estimates down. A little bit of the latter kind of scope creep is present in the Central Valley, in the form of more viaducts than originally planned; CARRD’s cost overrun estimate was based entirely on taking CAHSR’s unit costs and applying them to the added features as of 1-2 years ago. But the kind of scope creep we see on the Peninsula is entirely different: they are adding features that are of marginal operational use, and instead exist mainly to reinforce agency turf lines (namely, separation of agencies at San Jose).

My suspicion is that the same is true of the other segments. The fact that a cost overrun was averted on the initial construction segment in the Central Valley, after extensive value-engineering (for example, fewer viaducts), shows that the one segment CAHSR needs to build within budget in order to survive is indeed being built within budget. The other segments, for which the HSR Authority hopes to obtain private and local funding, offer easy opportunities for contractor profiteering: once the initial segment is built, there may well be momentum to complete the system, and the consultants could strong-arm local governments and the federal government to cough up more money. Indeed, no extra features useful to passengers have been added – everything is just about agency turf and more viaducts.

The only places where there could plausibly be an honest overrun, which cannot be eliminated simply by putting adults in charge and going back to older plans, are the mountain crossings. And indeed, the Grapevine alternative, now posited to be $1-4 billion cheaper than the Tehachapis, could resolve the major issue heading south toward the LA Basin. In the north, they keep studying the Altamont overlay with options including one proposed by SETEC that lets trains run at full speed right up until the built-up area of southern Alameda County; together with the Dumbarton water tunnel, it could help the project stay within budget by switching to a superior alternative, and avoid the San Jose viaduct mess entirely.

Although the political supporters of CAHSR tend to discount the Grapevine and be skeptical of switching to Altamont, they are still interested in the option of value-engineering. But it’s stupid to first propose an outrageous plan and then value-engineer it back to the original cost estimate. It offers no political advantages over doing it right the first time, and just breeds justifiable mistrust of the authority. For all I know, there could be a large real overrun that is not the result of agency turf wars.

To make sure people don’t react to the apparent factor-of-three overrun the way they should – i.e. propose to pull the plug unless costs are scaled down to reasonable levels – the 2012 plan includes higher numbers for the cost of doing nothing, i.e. of expanding freeways and airports to provide the same capacity. It was originally $100 billion, and is now $170 billion. This is less self-serving than it seems: the plan assumes a slower buildout and higher inflation, which accounts for most of the difference. But it’s still a backhanded way of trying to force the state to kick more money toward the contractors. If they can slow down airport and freeway construction (thereby increasing the final cost), perhaps they can halt it entirely – fair’s fair.

I’m still optimistic that they could put adults in charge and reduce costs to the original estimate, as they already have in the Central Valley. That is, if the federal government dangles a few billion dollars for the LA-Bakersfield segment and demands even a modicum of accountability, then they will gladly use the money to build a useful initial operable segment and only try to extort the public later. But optimistic and certain are not the same, and it’s an outrage that such a project could cost $65 billion. The tunnel-heavy Shin-Aomori extension of the Tohoku Shinkansen cost $4.6 billion for 82 km, a little more than half the proposed per-km cost of the new business plan – and Japan is a high-construction cost country.

Unless they cut the costs, I don’t see how I can continue to support the project. The initial construction segment, useless as it is on its own, is fine; the question is whether it stakes the territory for a very expensive future extension, or for one with reasonable cost. Since I doubt they’ll be able to get any additional money until they connect to the LA Basin except from the federal government and even then it will be a small number of billions, I think it’s the latter option. But the rest should be scrapped and restarted unless the construction costs drop dramatically. I would peg the maximum that the project can cost before it should be canceled, on the outside, at $60 billion or so in today’s money. This assumes timely construction – waiting decades with rapidly depreciating track hosting limited service makes the situation worse. The only consolation I have is that no matter what, the other projects they could spend the money on if CAHSR is canceled are even worse. And this says more about those other projects than about CAHSR.

Update: here is the cost escalation breakdown. It’s overwhelmingly the addition of new features, i.e. tunnels and viaducts, most of which are unnecessary (though one major issue, additional tunnels from Palmdale to LA, is required due to further study showing the need for more environmental protection). For example, Millbrae gets a gratuitous tunnel, previously estimated at $500 million, now estimated at $1.9 billion (p. 20). Unsurprisingly, SF-SJ has the biggest overrun, a factor of 2.5. Hat-tip goes to Clem for noting the extra cost of Millbrae, which I missed looking at just the business plan.

Update update: the California HSR Authority links rotted away, but were replaced with new ones. The page references remain valid; the reference to the cost in the first link at the beginning of this post is PDF-p. 15, and the reference to the breakdown of cost overrun by segment is in the update link, PDF-pp. 7-10. The cost estimate for the project was since revised down to $53 billion, in 2011 dollars, in the final 2012 business plan (see PDF-p. 23); this is entirely from leaving out the LA-Anaheim and SF-SJ segments for later, which avoids the Millbrae tunnel and other Peninsula luxuries, but does not address the extra costs of going through Palmdale or the cost overrun just south of San Jose.