Close this tab to return to the TAM RMS.

EM - Implementing Effective Resilience Performance Management

Funding

$300,000

Research Period

24 months

Background Information

The perennial question remains: what is an effective performance measure for transportation resilience in a community, state, or other jurisdiction? Progress toward good answers has been underway for several years, though desultory and usually off-target. The need for this research was further reinforced during the December 2022 AASHTO conference in Providence and the January 2023 TRB annual meeting, which included a handful of workshops and sessions that broached this subject. From the perspective of high-quality performance management practice, effective measures of resilience have been elusive. Our colleagues are very good at measuring resilience for specific infrastructure, an organization, or a supply chain, but not for community mobility. This research will tease out how best to really measure it, from a state-of-the-art performance management perspective, not just the easy but low-value event or activity tallies. Consider an agency or community investing in preparedness work, infrastructure hardening, or implementing a policy shift – what is the most effective, objective, outcome-based evidence for whether the jurisdiction is now more resilient than it was a year ago? There are some seeds of ideas, but the same questions are shared by multiple agencies, PIARC, AASHTO committees, TRB committees, and surely others.


Literature Search Summary

While there are several published resources referring to resilience performance, there remains a gap in effective performance measurement that this proposed research seeks to close.

Disaster Resilience Framework Workshop, 2015, San Diego. The workshop notes (unpublished) includes a section about Community Resilience Metrics.

Vulnerability Assessment and Adaptation Framework (VAAF), 2017, FHWA HOP (link). An important go-to guide for anybody working on transportation resilience.

Integrating Resilience into the Transportation Planning Process, White Paper on Literature Review Findings, 2018, FHWA HOP (link). A good resource for background and context, including a history of Federal rules on resilience. This document correctly places performance measure formulation after goals but before solutions.

Investing in Transportation Resilience: A Framework for Informed Choices, 2021, NAS/TRB (link). This also included a Committee on Transportation Resilience Metrics. The document includes some relevant points but is generally of limited value for performance management given its focus on project-specific evaluations and benefit-cost analysis.

Mainstreaming System Resilience Concepts into Transportation Agencies: A Guide, 2021, NAS/TRB (link). Follows on a 2018 resilience summit in Denver. A wealth of information about resilience, but measurement appears limited to project-specific risk reduction.

Developing Transportation System Climate Resilience Performance Measures, 2022, Minnesota DOT (link). A survey showed most states do not have resilience performance measures. Those that do are not outcome-based.

A Perspective on Quantifying Resilience: Combining Community and Infrastructure Capitals, 2023, Gerges et al (link).

Measuring Impacts and Performance of State DOT Resilience Efforts, 2022-2024, NCHRP 23-26, underway (link). Potentially valuable for this proposed research, but measures are not defined until after solutions and appear to focus only on monitoring project effects.

Transportation Asset Risk and Resilience, 2023-2026, NCHRP 23-32, pending/underway (link). A relatively large effort to generate new guidance, which may or may not include performance.

There are many laws, rules, references, and guidance documents going back many years, and right up to the current PROTECT Program guidance. The Further Consolidated Appropriations Act (2020), H.R.1865, calls on the “Secretary of Transportation to enter into an agreement with the National Academies of Sciences, Engineering, and Medicine to conduct a study through the Transportation Research Board on effective ways to measure the resilience of transportation systems and services to natural disasters, natural hazards, and other potential disruptions.”

Be wary of two tangents in literature: those focused solely on infrastructure and others about operational/organizational resilience, which are mostly unhelpful and distracting. Apart from published guidance, this research project will include a scan of select agencies to gather evidence and examples


Objectives

This research seeks to disentangle attempts to date and clarify what it means to have an effective, outcome-based, high-level performance management approach to resilience. Toward this end there are three essential parts:
1. Confirming definitions. For example, is resilience an inverse of vulnerability? Or an inverse of just sensitivity and adaptive capacity (e.g., per the Vulnerability Assessment Scoring Tool [VAST])? If resilience is infinite, is exposure irrelevant? Consistent with the VAAF, is there consensus on the definitions for risk, criticality, consequence, and other essential terms?
2. Community mobility, or mobility and destination access across a jurisdiction of any size, for all users and modes. This is distinct from infrastructure-focused resilience for a specific asset, e.g., a bridge. For a community subject to natural or human-caused disasters, how can they know whether they are more or less resilient? Is there a role for the broader 4R concept of Robustness – Redundancy – Resourcefulness – Rapidity?
3. Effective performance measures. Pin down for the resilience community what that means. Agency leaders need the most relevant, feasible, and quantifiable evidence of improved resilience that is outcome-based and trackable over time. These are not the abundance of output or activity metrics already in play, nor project-specific evaluations.
In addition to developed guidance, this project will pilot the implementation of a high-quality resilience performance measure into existing performance management frameworks for up to five agencies. Not only states, but MPOs, e.g. Los Angeles and San Diego have promising initiatives already developed.


Keywords/Terms

resilience, measures, performance management, community resilience


Link to 2021-2026 AASHTO Strategic Plan

This project would advance goals identified in the AASHTO Strategic Plan, most specifically the goal of “Safety, Mobility and Access for Everyone” that includes “strengthen resiliency.” This project would also support several strategies in the Strategic Plan, including establishing frameworks and tools to enable impactful policy decisions, supporting implementation within member agencies, advocating to minimize the impacts of climate change, and applying scenario planning to better weigh options in decision-making.


Urgency and Potential Benefits

Transportation resilience has grown in importance and this gap in practice needs to be addressed.
This research should be completed in parallel with the NCHRP 23-32 Risk & Resilience guidance development to be able to inform those products.
[to be expanded]


Implementation Considerations

This research would primarily be used by transportation agencies and others responsible for implementing resilience performance measures and management systems. Recently completed NCHRP Project 23-09 established a framework and research roadmap for assessing risk to agency assets and the traveling public from extreme weather, climate change, and other threats and hazards. Follow-on NCHRP Project 23-32 Asset Risk & Resilience will develop the technical resource in three phases, including planning, execution, and final product development. As described above, this research should be conducted along a parallel and complementary timeline. Critical implementation elements include a communication plan to ensure awareness of the research products and TRB, FHWA, and AASHTO webinars to share the findings.

A subsequent phase of this research funded through NCHRP 20-44 may be helpful to disseminate the research findings more broadly and develop case studies showing the use of the research guidance. There are several other AASHTO and TRB committees interested in resiliency that would likely support this project, including:

  • AASHTO
    • Committee on Performance Based Management (CPBM) Task Force on Emerging Performance Measures - Deanna Belden, Minnesota DOT and Kelly Travelbee, Michigan DOT, Co-Chairs
    • CPBM Subcommittee on Risk Management
    • Committee on Transportation System Security and Resilience (CTSSR)
    • Committee on Planning
    • Highways and Streets Council
  • TRB
    • Strategic Management (AJE10) - Steve Woelfel, Massachusetts DOT, Chair
    • Performance Management (AJE20) - Michael Grant, Chair
    • Asset Management (AJE30)
    • Risk Management (ATO40)
    • Critical Infrastructure Protection (AMR10)
    • Extreme Weather and Climate Change Adaptation (AMR50)
    • Transportation Planning Policy and Process (AEP10)
  • a. Communication and Implementation Funding: [to be completed]
  • b. Communication and Implementation Period: [to be completed]

Author(s)

Deanna Belden

Minnesota DOT

[email protected]

651-366-3734

Louis Feagans

Indiana DOT

[email protected]

317-412-1670

Lori Richter

Spy Pond Partners

[email protected]

608-628-8052

Peter Rafferty

Cambridge Systematics

[email protected]

608-216-5159


Others Supporting Problem Statement

Please add at least one supporting organization.

Potential Panel Members

Please add at least one potential panel member.

Person Submitting Statement

Please add information about the person submitting the statement.

Notes