WASHINGTON — While the Federal Motor Carrier Safety Administration’s Safety Measurement System used to identify commercial motor vehicle carriers at high risk for future crashes is conceptually sound, several features of its implementation need improvement, says a new Congressionally-mandated report from the National Academies of Sciences, Engineering and Medicine.
Over the next two years, FMCSA should develop a more “statistically-principled” approach for the task, based on an item response theory (IRT) model, an approach that has been applied successfully in informing policy decisions in other areas such as hospital rankings, says the report. If the model is then demonstrated to perform well in identifying motor carriers that need interventions, FMCSA should use it to replace SMS.
ATA President and CEO Chris Spear said, “This report has confirmed much of what we have said about the program for some time: The program, while a valuable enforcement tool, has significant shortcomings that must be addressed and we look forward to working with FMCSA to strengthen the program.”
Specifically, ATA noted the NAS study “validated the trucking industry’s concerns about the inclusion of certain types of violations in the CSA system, that geographic enforcement disparities can have a significant impact on carriers’ scores and that the collection and use of clean inspections is critical to the accuracy of the program.”
“We strongly agree with the National Academies’ conclusion that CSA should be based less on the ‘subject-matter expertise’ of enforcement and more on the empirically validated data,” said ATA Director of Safety Policy Sean Garney.
“The agency has received the National Academy of Sciences (NAS) report and is reviewing its findings and recommendations,” said FMCSA spokesman Duane DeBruyne. “As specified in Section 5221 of the Fixing America’s Surface Transportation (FAST) Act, the agency will provide its response to Congress and to the U.S. DOT Office of the Inspector General within 120 days of the report being provided to Congress.”
The report says that while commercial motor vehicle carriers are responsible for moving freight and passengers in a safe manner over the nation’s highways, about 100,000 fatality, or injury-causing crashes involving large trucks and buses occur in the United States each year."
Approximately 3.5 million CMV roadside inspections are conducted yearly by specially trained inspectors on approximately 900 potential violations of safety regulations that fall under six categories: unsafe driving, Hours of Service compliance, vehicle maintenance, controlled substances/alcohol use, hazardous materials compliance and driver fitness.
FMCSA uses information that is collected mainly during these inspections to identify motor carriers that are operating unsafely and therefore are likely to be at higher risk for future crashes. Carriers found to have frequent violations are subject to interventions from FMCSA, which can include warning letters and investigations, the report says.
The report identified a number of data-quality issues and recommended that FMCSA continue to collaborate with states and other agencies to improve the collection of data on vehicle miles traveled and on crashes, data which are often missing and of unsatisfactory quality, it says.
Including vehicle miles traveled data by state and month will enable SMS to account for varied environments where carriers travel — for example, in icy winter weather in the North — the report says. In addition, there is information available in police narratives not represented in the data used that could help in understanding the contributing factors in a crash.
In addition, the report says FMCSA should research ways of collecting data on carrier characteristics, including driver turnover rates, type of cargo, and method and level of compensation.
For example, compensation levels are relevant because it is known that drivers who are better-compensated, and those not compensated based on miles traveled, have fewer crashes.
This additional data collection would require greater collaboration between FMCSA and the states to standardize the effort and to protect carrier-specific information.
The committee that conducted the study and wrote the report was unable to recommend whether SMS percentile ranks should be made public because it would require a formal evaluation to understand the consequences of public knowledge of the information.
The study was sponsored by FMCSA. The National Academies of Sciences, Engineering, and Medicine are private, nonprofit institutions that provide independent, objective analysis and advice to the nation to solve complex problems and inform public policy decisions related to science, technology, and medicine.
The National Academies operate under an 1863 congressional charter to the National Academy of Sciences, signed by President Abraham Lincoln. For more information, visit http://national-academies.org.