The Department for Transport’s National Transport Model (NTM) was first constructed two decades ago and has subsequently undergone a number of phases of development. The main function of the model has been to provide projections of travel demand as the basis for justifying investment in the road network. The model has also been used to project future carbon emissions, to inform the Department’s Transport Decarbonisation Plan, as well as to explore the impact of technological developments such as electric vehicles.
An account of the latest version, effectively a new model known as NTMv5, was released recently in the form of a 250-page ‘Quality Report’, oddly, two years after completion. NTMv5 is a spatially detailed conventional four-stage transport model structure, iterated so that congestion feeds back into demand. The model has been implemented using the standard commercial software, PTV Visum. The intention is that the model should be transparent to external stakeholders, a very welcome development given the opacity of previous versions of the NTM. The complexity of the model means that a single run takes around ten hours, with a number of iterations needed to achieve convergence of outcomes.
However, there are some notable limitations to the model. There is no detailed treatment of public transport capacity. Car ownership data derives from a separate model, which has not been updated. And the primary source of growth of travel demand is the DfT’s National Trip End Model data set that projects expected changes in demography and land use, which are problematic of account of uncertainty of economic growth, population growth and distribution, and planning policy.
A number of potential applications of the model have been identified, of which the most immediate is the preparation of new national road traffic forecasts. Also recognised is a need to project future transport carbon emissions, and for the analysis of packages of road schemes at national level, including value for money.
The purpose of the succession of NTM versions has been to support the traditional ‘predict and provide’ approach to road investment. This viewpoint persists in the latest version where the stated rationale for analysis of packages of road schemes is to identify ‘gaps in the network… where the road capacity in future may be insufficient, leading to unacceptable rises in congestion and journey times.’ (section 2.4.2). Yet we do not adopt that approach when considering urban roads, and the scope for enlarging peri-urban motorways at acceptable cost by converting the hard shoulder to a running lane is now problematic on account of public concerns about safety. Besides, the scale of induced traffic has been persistently under-estimated in traffic modelling, so the aim of avoiding unacceptable congestion seems naïve, even before addressing the Net Zero objective.
The model builders struggled to treat the complexities of urban traffic. It was accepted that a full link-based modelling of urban road capacity and related journey time responses could not be achieved, and therefore a simplified approach had to be applied. This involves assuming general fixed speeds on urban networks for the Base Year, which were reduced over time based on assumed growth of demand. (sections 4.7 and 11.4). This simplification has implications for projections of traffic in London, as recognised by the peer reviewers.
Peer Review
The DfT has published a Peer Review and an Audit of NTMv5. The 120-page peer review, led by the seasoned practitioners John Bates and Ian Williams, drew attention to a number of apparent shortcomings in the methodology (too technical for me to appreciate sufficiently to offer comment). These led to counterintuitive results when sensitivity tests were run, notably for London.
The reviewers advise caution in application of the model, primarily due to the focus of the NTMv5 being on the more strategic highway network, whereas many of the potential applications focus on urban travel policy and public transport interventions. In particular, the reviewers are critical of the treatment of urban traffic, observing that the assumed relation between traffic speed and demand growth lack validity, and that the range of policies aimed at reducing urban car use are not taken into account. Besides, it is noted that the DfT’s car ownership model has not recognised that ownership in dense urban areas has been declining for many years in response to increasing population density, notwithstanding rising incomes.
The reviewers find that for London, the model results are not convincing. The observed car (driver + passenger) trip mode share is 38% from the National Travel Survey in 2015/16, whereas that in the model in 2015 is 50%. Moreover, the model projects a future gain of car share, whereas over the period 2005-16 a major decline of 5.6% was observed (para 4.3.5). The reviewers concluded that the model could not be safely used to examine policies that relate specifically to London, and query whether this relates more generally to rapidly growing dense urban areas across England. They took the view that the model should be suitable for use in forecasting the growth of road traffic in most areas other than those adjacent to or within major urban areas (section 6.3.24), which is a pretty major qualification.
Audit
The 260-page audit of NTMv5, carried out by consultants Arup and AECOM, drew attention to a number of shortcomings in both documentation and substance, including that some of the model components and tools used to process the data are not owned by the Department, which limited access to some of the key processes and data used in model development – not consistent with the aim of transparency to external users. The auditors advised that users of model outputs should be cautious because of problems in reaching convergence to a stable outcome as the model is run through repeated iterations, a concern also of the peer reviewers.
What next?
The NTM documents recently published are two years old. No doubt, further development of the model has been taking place to respond to the issues raised in peer review and audit. In its Transport Decarbonisation Plan published last July, the DfT stated its intention to review the National Policy Statement on National Networks, the basis of strategic planning of road and rail investment, and to update the forecasts on which it is based. NTMv5 will presumably be used for this purpose. Yet the modellers will be stretched to meet the divergent needs of their client policy makers, between bullish forecasts of travel demand to justify continued infrastructure investment and bearish projections of transport carbon emissions. Given the uncertainties of the model illuminated by peer review and audit, it will be hard to be confident about the validity of carbon forecasts out to 2050 and 60-year investment appraisals.
While the DfT’s intention to make NTMv5 available for use beyond the Department is praiseworthy, this seems problematic in practice. Doubtless the large transport consultancies could master the software and data, but given their complexity, clients would need deep pockets to fund the work. That would rule out non-government bodies that might want to challenge particular schemes. Regional transport undertakings have their own bespoke models. I am not aware of any academics who would be likely to buy into the NTM, a situation unlike national energy modelling where government and a substantial group of university researchers work with the same model. The DfT would be well advised to support academic researchers and others wishing to use NTMv5 to explore a range of policy scenarios.
This blog was the basis for an article in Local Transport Today of 11 March 2022.