Replicating Threats in Operational Test and Training Infrastructure

The Investment Required to Keep Pace with Adversary Threat Generation

Anna Jean Wirth, John A. Ausink, Bradley DeBlois, Sale Lilly, Dara Massicot, Maria McCollester, Ronald G. McGarvey, Michael Kennedy, Shane Tierney, Liam McLane

ResearchPublished Dec 6, 2023

There are concerns that the rate at which China and Russia can field new technologies exceeds the rate at which the U.S. Air Force (USAF) can replicate those technologies in operational test and training infrastructure (OTTI). The authors of this report estimate the rate at which China and Russia field new threats and examine the costs and benefits of keeping USAF OTTI at pace with new adversary capabilities.

The authors find that China and Russia are fielding new threats at rates exceeding that at which the USAF has historically been able to field new OTTI and that significant investment is required to keep OTTI at pace with adversary technology developments. This analysis provides a target for funding and fielding timelines that, if achieved, could edge the USAF training community closer to keeping the training environment at pace with new adversary technology.

Key Findings

China and Russia are fielding new threats at rates exceeding that at which the USAF has historically been able to field new OTTI

  • The rate at which new technology is fielded by China and Russia is quite fast, potentially requiring OTTI investment to replicate incremental changes to threats annually and more significant threats every few years.
  • The USAF has historically been able to replicate new threats in virtual OTTI in four to five years and in live OTTI in seven to ten or more years.

Significant investment is required to keep OTTI at pace with adversary technology developments

  • Extrapolating from historical investments in threat replication, the cost to replicate threats in OTTI at the pace of adversary threat development is $300 million per year.

To achieve the full benefit of OTTI investment and to “keep pace,” fielding timelines for OTTI must be reduced to a timescale comparable to the rate at which China and Russia field new threats

  • Although there can never be an instantaneous OTTI response to every newly fielded adversary threat, bringing OTTI fielding timelines closer to the adversary threat refresh rate will diminish the degree to which the USAF falls behind.

Recommendations

  • Focus efforts to collect data on the costs to develop new threats in virtual OTTI, which would enable evaluation of whether replicating threats in the virtual environment could offer a path to faster and more cost-effective replication of threats in the training environment.
  • Invest in efforts to collect better data on pilot proficiency, which can enable more precise tuning of OTTI investments to enhance operational outcomes.
  • If the USAF desires to keep OTTI at pace with new adversary threats, aggressively seek to decrease OTTI fielding timelines, in addition to advocating adequate funding, by pursuing resource allocation and acquisition acceleration strategies.

Order a Print Copy

Format
Paperback
Page count
148 pages
List Price
$49.95
Buy link
Add to Cart

Document Details

  • Availability: Available
  • Year: 2023
  • Print Format: Paperback
  • Paperback Pages: 148
  • Paperback Price: $49.95
  • Paperback ISBN/EAN: 1-9774-1198-3
  • DOI: https://doi.org/10.7249/RRA1002-1
  • Document Number: RR-A1002-1

Citation

RAND Style Manual

Wirth, Anna Jean, John A. Ausink, Bradley DeBlois, Sale Lilly, Dara Massicot, Maria McCollester, Ronald G. McGarvey, Michael Kennedy, Shane Tierney, and Liam McLane, Replicating Threats in Operational Test and Training Infrastructure: The Investment Required to Keep Pace with Adversary Threat Generation, RAND Corporation, RR-A1002-1, 2023. As of April 8, 2025: https://www.rand.org/pubs/research_reports/RRA1002-1.html

Chicago Manual of Style

Wirth, Anna Jean, John A. Ausink, Bradley DeBlois, Sale Lilly, Dara Massicot, Maria McCollester, Ronald G. McGarvey, Michael Kennedy, Shane Tierney, and Liam McLane, Replicating Threats in Operational Test and Training Infrastructure: The Investment Required to Keep Pace with Adversary Threat Generation. Santa Monica, CA: RAND Corporation, 2023. https://www.rand.org/pubs/research_reports/RRA1002-1.html. Also available in print form.
BibTeX RIS

Research conducted by

This research was prepared for the Department of the Air Force and conducted within the Resource Management Program of RAND Project AIR FORCE.

This publication is part of the RAND research report series. Research reports present research findings and objective analysis that address the challenges facing the public and private sectors. All RAND research reports undergo rigorous peer review to ensure high standards for research quality and objectivity.

This document and trademark(s) contained herein are protected by law. This representation of RAND intellectual property is provided for noncommercial use only. Unauthorized posting of this publication online is prohibited; linking directly to this product page is encouraged. Permission is required from RAND to reproduce, or reuse in another form, any of its research documents for commercial purposes. For information on reprint and reuse permissions, please visit www.rand.org/pubs/permissions.

RAND is a nonprofit institution that helps improve policy and decisionmaking through research and analysis. RAND's publications do not necessarily reflect the opinions of its research clients and sponsors.