While the Federal Motor Carrier Safety Administration’s (FMCSA) Safety Measurement System used to identify commercial motor vehicle carriers at high risk for future crashes is conceptually sound, several features of its implementation need improvement, says a new congressionally mandated report from the National Academies of Sciences, Engineering, and Medicine.
The report concluded that over the next two years, FMCSA should develop a more statistically principled approach for the task, based on an item response theory (IRT) model -- an approach that has been applied successfully in informing policy decisions in other areas such as hospital rankings. If the model is then demonstrated to perform well in identifying motor carriers that need interventions, FMCSA should use it to replace SMS.
About 100,000 fatality- or injury-causing crashes involving large trucks and buses occur in the United States each year, the report says. Approximately 3.5 million CMV roadside inspections are conducted yearly by specially trained inspectors on approximately 900 potential violations of safety regulations that fall under six categories: unsafe driving, hours of service compliance, vehicle maintenance, controlled substances/alcohol use, hazardous materials compliance, and driver fitness.
FMCSA uses information that is collected mainly during these inspections to identify motor carriers that are operating unsafely and therefore are likely to be at higher risk for future crashes. Carriers found to have frequent violations are subject to interventions from FMCSA, which can include warning letters and investigations, the report says.
The report identified a number of data quality issues and recommended that FMCSA should continue to collaborate with states and other agencies to improve the collection of data on vehicle miles traveled and on crashes, data which are often missing and of unsatisfactory quality. Including vehicle miles traveled data by state and month will enable SMS to account for varied environments where carriers travel -- for example, in icy winter weather in the North. In addition, there is information available in police narratives not represented in the data used that could be helpful in understanding the contributing factors in a crash.
In addition, the report says FMCSA should research ways of collecting data on carrier characteristics -- including driver turnover rates, type of cargo, and method and level of compensation. For example, compensation levels are relevant because it is known that drivers who are better-compensated, and those not compensated based on miles traveled, have fewer crashes. This additional data collection would require greater collaboration between FMCSA and the states to standardize the effort and to protect carrier-specific information.
“We strongly agree with the National Academies’ conclusion that CSA should be based less on the ‘subject-matter expertise’ of enforcement and more on the empirically validated data,” said ATA Director of Safety Policy Sean Garney. “We also see great potential in the Academies’ recommendation that FMCSA overhaul the current CSA methodology in favor of a new, more adaptive, data-centric model with the potential to address serious flaws in the system.
Specifically, ATA noted the NAS study validated the trucking industry’s concerns about the inclusion of certain types of violations in the CSA system, that geographic enforcement disparities can have a significant impact on carriers’ scores and that the collection and use of clean inspections is critical to the accuracy of the program.
