Working Group 24 Charter: Test and Evaluation


(Updated October 2014)

Purpose:  The purpose of the Test and Evaluation (T&E) Working Group (WG) provides a forum for military, government, and civilian operations research analysts to examine topics, methodologies, analyses, and innovations pertinent to all aspects of planning, designing, executing, and reporting of formal T&E in the Department of Defense (DoD) and other government departments and agencies, as well as key international allies.

Discussion:  Various organizations have been struggling with T&E implementation issues and, as a result, have been building their own repertoire and standards in T&E improvements and innovations. Because of these efforts, there have been various levels of success in applying operations research tools and techniques to T&E.

The T&E Working Group brings together Service, government, academic, and industry testers to share lessons learned in order to improve T&E strategies and methods.  Possible topics for presentations include:

·      implementation of Design of Experiments (DOE) in T&E

·      T&E of current acquisition programs

·      advantages and disadvantages of bundling test programs

·      observations of the Army Network Integration Evaluation (NIE) and its role in the T&E community

·      designing credible tests with limited resources

·      developing meaningful Measures of Effectiveness (MOE)

·      use of small sample sizes

·      advantages of different test designs

·      overlaying experiments on training exercises or field tests

·      impact of data collection on player participation

·      timeliness of analysis

·      implementation and sharing of results/lessons learned

The T&E Working Group will solicit input and discussion from the analysts who are involved in the planning, design, execution, and analyses of T&E.  To understand and improve the entire process, participants from throughout the entire T&E community will be included.  This community includes the organization leaders who develop and approve T&E programs and budgets, service and government staff agencies who are customers of T&E results, members of the acquisition community who participate with experimental hardware or software, combat developers who provide experimental concepts and scenarios, service operational testers and modelers who use T&E data, and service operational forces who support T&E as participants.

WG-24 encourages presentations on both completed work and work in progress.

Other Working Groups:  Candidates for joint discussions with WG 24 include:

·      Human Behavior and Performance (DWG 1)

·      Experimentation (WG 22)

·      Measures of Merit (WG 23)

·      Modeling and Simulation (WG 28)