(Updated October 2014)
Purpose: The purpose of the Test and Evaluation (T&E) Working Group (WG) provides a forum for military, government, and civilian operations research analysts to examine topics, methodologies, analyses, and innovations pertinent to all aspects of planning, designing, executing, and reporting of formal T&E in the Department of Defense (DoD) and other government departments and agencies, as well as key international allies.
Discussion: Various organizations have been struggling with T&E implementation issues and, as a result, have been building their own repertoire and standards in T&E improvements and innovations. Because of these efforts, there have been various levels of success in applying operations research tools and techniques to T&E.
The T&E Working Group brings together Service, government, academic, and industry testers to share lessons learned in order to improve T&E strategies and methods. Possible topics for presentations include:
· implementation of Design of Experiments (DOE) in T&E
· T&E of current acquisition programs
· advantages and disadvantages of bundling test programs
· observations of the Army Network Integration Evaluation (NIE) and its role in the T&E community
· designing credible tests with limited resources
· developing meaningful Measures of Effectiveness (MOE)
· use of small sample sizes
· advantages of different test designs
· overlaying experiments on training exercises or field tests
· impact of data collection on player participation
· timeliness of analysis
· implementation and sharing of results/lessons learned
The T&E Working Group will solicit input and discussion from the analysts who are involved in the planning, design, execution, and analyses of T&E. To understand and improve the entire process, participants from throughout the entire T&E community will be included. This community includes the organization leaders who develop and approve T&E programs and budgets, service and government staff agencies who are customers of T&E results, members of the acquisition community who participate with experimental hardware or software, combat developers who provide experimental concepts and scenarios, service operational testers and modelers who use T&E data, and service operational forces who support T&E as participants.
WG-24 encourages presentations on both completed work and work in progress.
Other Working Groups: Candidates for joint discussions with WG 24 include:
· Human Behavior and Performance (DWG 1)
· Experimentation (WG 22)
· Measures of Merit (WG 23)
· Modeling and Simulation (WG 28)