Terms of Reference

MORS Workshop:
Operations Analysis Support to Network Centric Operations

1. Background

As Network Centric Operations (NCO) are being developed, assessment needs vs. capability gaps are being discussed and options considered by the U.S. Armed Forces.  In these early stages, an assessment of Operations Analysis to support Network Centric Operations needs to be conducted.

For instance, functional requirements and metrics need to be developed.  Some MOEs and MOPs have been developed for some mission areas, but not for the higher level command and control functions.  Also, what are the analytic processes to assess Network Centric Operations for PPBS and joint experimentation?  What methodologies will enable quantification, insight and understanding on NCO Concepts of Operations?  What Modeling & Simulation is available to support assessments of NCO Concepts and what are the campaign model limitations?

Additionally, our growing Operational and Systems Architectures need to be leveraged as we understand bandwidth requirements.  How can NCO be applied in the Force Transformation Process?  How will it shape force structure and the concepts of operations?  What are the inter-relationships between information and weapons systems?

Furthermore, are there interoperability issues among the Joint, Allied and Coalition Forces?  How are Allied & Coalition Forces using operations analysis to support NCO?  What are their lessons learned?  How do we stay in step with the Coalition Forces?  What do we do for those Coalition Forces that will not / cannot participate in the network?  What about with U.S. Agencies, such as Homeland Security, Justice, etc.?

Finally, how can effects-based operations be applied to NCO?  How effective are our Information Warfare operations?  When is it more effective to achieve non-lethal vs. lethal effects?  How do we determine how effective Information Warfare is?  What are the co-evolving landscapes in C4ISR?  Are there better data practices?  How do cognitive and behavioral factors influence command and control?

This Workshop will research and examine the above questions, using the applicable NCO-related findings of the recently completed MORS Special Meetings on Effects-Based Operations, Information Operations, C4ISR, Data Practices, Cognitive and Behavioral Factors Influencing Command and Control, and Decision Support.  

2. Goals and Objectives

Many organizations are interested and involved in employing and analyzing Network Centric Operations.  The analytic community needs to support the military services with assessments as Network Centric Operations is being developed.  The community should play a leadership role in creating/refining these needed metrics, processes, methodologies, models and simulations.  The community should share efforts, successes and failures in the key capabilities.

The goal of this meeting is to provide an opportunity to bring a multi-disciplined team of analysts, operators and engineers from those organizations together to share their work, develop a common view of the state of practice, expose members of the broader analytic community to their needs, identify shortfalls and potential solutions.

There are several overarching issues each working group will consider.  They are:

The overall objectives of this special meeting on Operations Analysis Support to Network Centric Operations will be to provide an assessment and a roadmap to revitalize the state of the analytical practice and to recommend priorities for any initiatives identified.  Some specific objectives for the Working Groups include recommending:

3. Approach

1. 1^st Day – Mini-Symposium – The meeting will commence with a mini-symposium format that will include operational based discussions as well as progress to date.  The purpose of this portion is to bring all participants up to speed on the state of the practice and frame the analytical challenges and issues for the working groups. 

   1. Keynote Presentation (~ 1 hour presentation with 15 minutes for Q&A) – From a high, Joint-level perspective:

      1. Define and provide a brief background on Network Centric Operations

      2. Identify the overriding challenges the analytical community needs to address

      3. Provide an overview of the progress to date using operations analysis to support NCO, including any problems and paradoxes

   2. Service Presentations (total – 1 ½ hours with ~ 15 minutes for each Service and ~ 15 minutes available for questions) –

      1. Presentations – (each Service and 1 Coalition Country; ~ 15 minutes each)

- Provide an overview of the challenges and progress to date using operations analysis to support NCO (with examples)

- Highlight context, issues, what is needed from the analytical community

- Identify some of the broad analytical and difficult questions

2. Q&A – After all presentations, the remaining time (~ 15 minutes) will be for questions

3. Framework Presentations ( ~ 1 ½ hours) –

1. An Overview of NCO Differences (~ 45 minutes) – Comparing and contrasting the NCO differences:

- Among the U.S. Services

- With the U.S. Agencies (i.e., HLS, Justice, etc.)

- With the Coalition Forces

- Highlighting OA examples, where appropriate

2. What is Network Centric Operations? (~ 20 minutes)

- After the attendees have listened to the Keynote, Service and NCO Differences presentations, this is a brief to focus the Working Group discussions

3. What is the Operations Analysis Process? (~ 30 minutes)

 - This is another brief to focus the Working Group discussions

- A review of the OA process to see how OA “fits” in the six Working Groups

4. Guidance Presentations (~ 1 ½ hours)  –

1. Workshop Introduction Brief – by the Special Meeting Co-Chairs (~ 20 minutes)

- Discuss the Working Group objectives

- Highlight the overarching analytical issues

- Provide a schedule overview for the Workshop

- Introduce the Working Groups and their Chairs, Co-Chairs & Advisors

2. Technical Chair Comments and Guidance (~ 10 minutes)

3. Reports on previously completed related MORS Workshops (listed above), highlighting any relationships to NCO (~ 50 minutes è ~ 10 minutes each)

4. Synthesis Group Overview – by Synthesis Group Chair (~10 minutes)

- Discuss the role of the Synthesis Group

- Highlight what input is desired from the attendees

- Introduce the Synthesis Group

2. 2^nd & 3^rd Day – Workshop – The Mini-Symposium will be followed by a two-day workshop where participants will meet in working groups to further examine specific topics, including discussing the overarching issues of the Workshop.  Working groups will prepare a report on their activities to present to other workshop participants at the last session of the workshop.  To focus the discussion in each of the working groups, a select group of people will be requested to prepare and present papers.  The workshop attendees will be organized into six working groups plus a synthesis group.  The working group structure is detailed below.

   1. WG 1:  Measures of Merit – Using the OSD project on NCW Framework and Dr. Albert’s “Maturity Matrix” to measure progress of the network as a foundation, this working group will examine the functional requirements and metrics being developed for Network Centric Operations.  Some potential discussion points include:

      1. What are the issues from previous work on NCO metrics?  Are any of these issues not defined?  If so, which ones?

      2. What is the status of not only the network MOPs, but also the transformation MOEs?  Network MOPs may not capture the synergy associated with being able to network.

      3. The Army’s Future Combat System and the Navy’s FORCEnet have metrics. 

- Are they consistent?

- Are they inclusive? 

- Are they adequate?

4. What about the Key Performance Parameters (KPPs)?  What should they be?

5. Can the previously proposed NCO measures be “audited” to determine where the gaps are?

6. Can “traditional” metrics make a contribution to evaluating NCO?  If so, how?  If not, why not?

7. What is the frame of reference for examining the relationship among NCO, Rapid Decisive Operations (RDO) and Effects Based Operations (EBO) metrics?  Define the common areas.  By doing so, this may enhance the ability to use the previous work on metrics for RDO and EBO that applies to NCO.

8. How do you determine and link metrics across the physical, information, cognitive and social domains?  What are the metrics in each domain?

9. What are observable and measurable metrics vs. intangible metrics?
10. How are the new metric hierarchies linked to combat power and outcomes?

2. WG 2:  Processes and Methodologies – This working group will examine analytical processes and methodologies to optimize and evaluate Network Centric Operations.  Some potential discussion points include: 

   1. Analysis process changes needed in order to assess NCO in light of the forces of transformation, e.g., EBO, capabilities-based acquisition, spiral development, increasing JFCOM role and “joint” task force capabilities perspective, and increasing involvement with NGOs, international entities, and OOTW. 

- What processes changes are needed to better reflect the importance of joint experimentation (assessing concepts) and the potentially decreasing need for traditional mission analysis, and to involve stakeholders more? 

- What are the emerging implications for the methodologies and tools that support these processes, e.g., emerging need for mini-wargames to supplant or supplement campaign level models? 

- Given the analytical community’s current capability in assessing NCO, what process changes could be implemented in the interim and what needs to take a longer-term perspective, e.g., process improvement road map ?

2. The methodologies to enable quantification, insight and understanding of NCO CONOPS and information age paradigms.

3. WG 3:  Assessment Tools – This working group will examine and recommend the modeling and simulation to support assessments, i.e., POM to system engineering to experimentation of NCO Concepts, including the role of wargames, field experiments and exercises.  Some potential discussion points include:

   1. The campaign model limitations

- Currently assume “perfect knowledge / ISR”

- Recommended solution (FORCEnet, CEC, etc.) goals are to deliver “near-perfect environment” … shows no delta in performance

2. Representation of C2, human, organizational behaviors and interactions

- Trust in netted environment

- History of “mistakes”

3. The representative hierarchy of models

4. WG 4:  Force Transformation Process – This working group will examine how using OA in support of Network Centric Operations can be applied in the “Force Transformation Process”.  Some potential discussion points include:

- NCO assessments shaping force structure and the concepts of operations

- Operational and system architectures required

- NCO doctrine towards transformation

- Inter-relationships between information and weapons systems

5. WG 5:  NCO and Coalition Forces – This working group will examine applying OA to Network Centric Operations and interoperability among the Joint, Allied and Coalition Forces.  Some potential discussion points include:

- In addition to the Joint Forces, how are other (i.e., Allied & Coalition) Forces using operations analysis to support NCO?

- What are their lessons learned?

- What collaboration assessments have been accomplished among the Joint and Coalition Forces?

- How do the Joint Forces stay in step with the Allied & Coalition Forces?  Training, exercises, policy?  Information sharing?

- How do the Joint Forces maintain the relationship with those Coalition Forces that are not / can not get on the network?

6. WG 6:  Applying NCO to an Actual Event – This working group will examine how applying OA to Network Centric Operations enables time critical events.  Some potential discussion points include:

- What is a collaborative target?

- In what length of time is “critical”?

- How can quick-turnaround analyses support the event? 

- What type(s) of analysis(es) is(are) recommended?

- The different ways the Air Force used OA and lessons learned in recent events to reduce the time from 4 hours to 45 minutes (with a goal of 2-3 minutes)

7. Synthesis – The synthesis group will bring together the work of the six working groups and develop overall assessment/recommendations from the analysis community for the individual service operations analysts to consider.

4. Agenda – (tentative)

The tentative utilization for the working group sessions will be:

5. Attendees

1. Attendance will be by invitation only.  Attendees will include invited experts from OSD, all Services, the Joint Staff, University Affiliated Research Centers, Federally Funded Research and Development Centers, operational commanders, DoD contractors and others, including representatives from our Allied / Coalition Analytical Communities .  Workshop chairs will control membership of their sessions in conjunction with the Organizing Committee.  Attendance will be limited to 200 people.

2. Working Groups (WGs) will be led by a Chair, one to three Co-Chairs and an Advisor.  This leadership group will be comprised of all MORSians or a combination of MORSians and Subject Matter Experts (SMEs).  The responsibilities of this team include:
   1. Chair – 

      1. Dynamic individual that is a SME in the WG topic

      2. Solicits analysts and operators in the field to participate in the WG

      3. Guides the WG during the Workshop

      4. Challenged to provide the “substance” of the special meeting WG

      5. Develops the WG’s final product

2. Co-Chair – Individual interested in WG topic; assist Chair as Chair requests

3. Advisor – Individual that is a SME in the operational side of the WG topic; assists Chair in WG membership, provides perspective during Workshop, and assists Chair as requested

3. Another key group of individuals during the Workshop is the Synthesis Group.  This group will provide representation to each of the WGs and assist the Workshop Chairs consolidate the working group results and develop overall assessment/recommendations from the analysis community for the individual service operations analysts to consider.

6. Products –

Several products will be generated from the workshop:

7. Milestone Table

See the OA Support to Network Centric Operations Plan of Actions & Milestones

8. Proponents

9. Planning and Organizing Committee

Working Group Chairs:

WG1 – Measures of Merit

Chair – Jim Jacobs, Northrop Grumman IT
Co-Chair – John Furman, The MITRE Corporation
Advisor – Dr. Kimberly Holloman, Evidence Based Research, Inc.

WG 2 – Processes & Methodologies:

Chair – Dr. Daniel Maxwell, Evidence Based Research, Inc.  
Co-Chair – Ralph Klingbeil, Naval Undersea Warfare Cente
Co-Chair – Jeffrey Vick, Boeing Military Studies & Analysis

WG 3 – Assessment Tools:

Chair – Dr. Mark Youngren, The MITRE Corporation
Co-Chair – Steven Beres, Evidence Based Research, Inc.
Co-Chair – TJ Ferrell, Boeing Military Studies & Analyses
Advisor – LtCol Gregory McIntyre, JWARS, OSD(PA&E)

WG 4 – Force Transformation Process: 

Chair – CDR Bob Gregg, JFCOM – Analysis Division
Co-Chair – Bill Bristow. JFCOM – Analysis Division
Advisor – Dr. John Hanley, IDA

WG 5 – NCO & Coalition Forces:

Chair – COL Pat Vye, ODUSA(OR)
Co-Chair – Ray Christian, Naval Undersea Warfare Center
Co-Chair – Joe Quartararo, JFCOM

WG 6 – Applying NCO to Actual Events:  TBD

Sponsor/Service Reps:

Air Force: Roy Reiss, Air Force Studies & Analyses Agency
Army: COL Hoa Generazio, ODUSA(OR)
Navy: CDR John Oberst, LCDR Dan Schebler & Herb Cupo, N81
Marine Corps: Dr. George Akst, MCCDC Studies & Analysis
Joint Staff: COL Wilmer Sweetser, JS (J8)
OSD: Mr. Jim Bexfield, FS, OSD(PA&E)

MORS Workshop Briefs:

Analyzing EBO – Dr. Richard Hayes & Sue Iwanski
OR Methods for IO – Dr. Dick Deckro
Advancing C4ISR – Dr. Stuart Starr, FS, Charles Taylor and Cy Staniec
Better Data Practices – Tom Allen
Influence C&C – Priscilla Glasow
Decision Support – Pat McKenna

10. Administrative

Name – Operations Analysis Support to Network Centric Operations

Dates – 27-29 January 2004

Location – Booz Allen Hamilton, McLean, VA

Fees –

Mini-Symposium Only: U.S. Federal Government $115 and $230 for all others
Entire Workshop: U.S. Federal Government $225 and $450 for all others

Attendance – 200 people, by invitation

Dear Colleague Letter

Some of our links are in portable document format (pdf); they will be indicated by this symbol . To read these files you must have Acrobat Reader^®. You can download Acrobat Reader^® by following this link .

Please read our disclaimer.
Send mail to corrina@mors.org with questions or comments about this web site.
Copyright © 1997-2006 Military Operations Research Society
Last modified: February 05, 2004