DOT&E FY2014 Annual Report. Michael Gilmore, Director – Operational Test & Evaluation Office of the Secretary of Defense: “Since my appointment as Director, I have required thorough operational tests that provide adequate information to characterize system performance across a variety of operational conditions. This information is essential to my evaluation of system operational effectiveness, suitability, and survivability. I have advocated the use of scientific methodologies, including experimental design or design of experiments (DOE) to ensure that this characterization is done as efficiently as possible. The methodologies that I have advocated for not only provide a rigorous and defensible coverage of the operational space, they also allow us to quantify the trade-space between the amount of testing and the precision needed to answer the complex questions about system performance. They allow us to know, before conducting the test, which analyses we will be able to conduct with the data and therefore, what questions about system performance we will be able to answer. Finally, they equip decision makers with the analytical tools to decide how much testing is enough in the context of uncertainty.”

• See also – Nearly every U.S. arms program found vulnerable to cyber attacks