Measuring Cyber and Information Operations

Measuring Cyber and Information Warfare

* MORS' website limitedly supports Internet Explorer and Firefox. For best results, use Chrome.

No course is currently scheduled for this topic but if you would like to set up a private course for your organization, please contact Ms. Jennifer Ferat, Director of Professional Development at jennifer.ferat@mors.org

Overview

On 11 March 2020, the 2019 National Defense Authorization Act (NDAA) directed Cyberspace Solarium Commission (CRC) Report was released.  The CSC was tasked to conduct a bipartisan review of cyber threats to the US and provide strategic guidance and policy recommendations on how to better defend the nation against those threats.  The report contains 83 recommendations spread across six pillars.

A key enabling recommendation – 6.1.6: Require Department of Defense to Define Reporting Metrics – will no doubt be part of the 2021 NDAA.  The purpose of this MORS Special Meeting is to begin to define these metrics by bringing key players across the cyber domain together to discuss, game plan, and determine a way ahead that incorporates the combined skill and knowledge of the communities. Similar to April 2019’s Urban Operations Special Meeting, a hybrid mini-symposium is planned that will include a group discussion – on the last day – focused on development and refinement of promising metrics. Given the topic, this Special Meeting will at least be restricted to U.S. Government Agencies and their contractors.

Working Groups:

  • Working Group #1: Cyber Metric Assessment
  • Working Group #2: Information Operations Assessment
  • Working Group #3: National Level Assessment
  • Working Group #4: Data Collection Efforts

Working Group Topics:

  • Tactical and Operational Cyber Assessment
  • Tactical and Operational Information Warfare Assessment
  • Strategic Assessment
  • Use of Existing and Proposed Datasets

Keynot Speaker

Mr. Michael A. Clark

Mr. Michael A. ClarkDeputy Director, Plans and Policy (JS) United States Cyber Command (USCYBERCOM)
Mr. Michael Clarke recently serves as a Deputy Director for Plans and Policy. He provides leadership, advice, and technical guidance on cyberspace issues related to the Department of Defense, congressional and presidential positions, operations roles and missions, the development and implementation of international and interagency partnership, policy, national security plans, military strategy, doctrine, and capability requirements supporting the execution of the US CYBERCOM mission.

Confirmed Speakers:

Dr. Erica Borghard

Assistant Professor, Army Cyber Institute United States Military Academy

Mr. Chuck Burdick

IDI

Mr. Michael A. Clark

Deputy Director, Plans and Policy (JS) United States Cyber Command (USCYBERCOM)

Dr. Emily Goldman

Cyber Strategist and Cyber Persistence SME, U.S. Cyber Command and the National Security Agency

Mr. Jason Healey

Columbia University School of International and Public Affairs

Mr. Armand D. Kinslow

MITRE

Dr. Ryan Maness

Naval Postgraduate School

Mr. Charles “Bill” Robinson

Joint Force Development and Design Center, Joint Staff (Suffolk) J7

Mr. Benjamin Schechter

US Naval War College

Dr. Julie A. Steinke

MITRE

Dr. Fuzzy Wells

UCF/IST

Agenda

Tuesday, 27 October

1030 - 1035 EDT Welcome to MORS Measuring Cyber and IO Workshop
Dr. Marv King, Workshop Chair Online

1035 - 1050 EDT Welcome
CAPT Brian Morgan (Retd.), MORS President
Online

1050 - 1140 EDT Keynote Address
Mr. Michael A. Clark, Deputy Director, Plans and Policy (J5), United States Cyber Command (USCYBERCOM)
Online

1140 - 1200 EDT Workshop Outcomes and Cyber Reporting Metrics
Dr. Marv King, Workshop Chair
Online

1200 - 1330 EDT Lunch

1330 - 1500 EDT Working Group #1 Cyber Metric Assessment
Chairs: Ms. Kate Buckley, Raytheon Technologies and
Dr. Julie A. Steinke, MITRE
Online

  • Measuring the Effectiveness of TTP-Based Hunting Methodology: The Problem, the Solution, and the Results
    Armand D. Kinslow, MITRE
  • Measures of Effectiveness for Determining Effects of Cyber Operations as a Team Sport and Identifying the Measures of Performance as a Team
    Julie A. Steinke, MITRE

1500 - 1530 EDT Break

1530 - 1700 EDT Working Group #2 Information Operations Assessment
Chairs: Mr. Chuck Burdick, Innovative Decisions Inc and
Dr. “Fuzzy” Wells, Deputy Director, Institute for Simulation & Training, University of Central Florida
Online

  • Tools/Sources to produce Cyber Assessment Results (Cycle of Learning/Research)
    Charles “Bill” Robinson, Joint Force Development and Design Center, Joint Staff (Suffolk) J7
  • Assessment options in Exercises, Training Data, Tests, and Experiments

Dr. Fuzzy Wells, UCF/IST

  • Assessment Options in Simulation & Simulation-Supported/Augmented Wargaming

Mr. Chuck Burdick, IDI

Wednesday, 28 October

1020 - 1030 EDT Introduction to Day 2
Dr. Marv King, Workshop Chair
Online

1030 - 1200 EDT Working Group #3 National Level Assessment
Chair: Mr. Kyle Wilkinson
Online

  • Erica Borghard, Assistant Professor, Army Cyber Institute, United States Military Academy
  • Measuring to “Reshape the Cyber Ecosystem toward Greater Security” - - Grappling with Federal/State Decentralization

Mr. Benjamin Schechter, US Naval War College

  • Persistent Engagement and Strategic Cyber Competition - Implications for Measuring the Effects of Cyber Campaigns

Dr. Emily Goldman, Cyber Strategist and Cyber Persistence SME, U.S. Cyber Command, and the National Security Agency

1200 - 1330 EDT Lunch

1330 - 1500 EDT Working Group #4 Data Collection Efforts- Panel

  • Ryan Maness, Naval Postgraduate School
  • Jason Healey, Columbia University School of International and Public Affairs
  • Marv King, Workshop Chair
    Online

1500 - 1530 EDT Break

1530 - 1700 EDT Working Group Break-Out for Discussion
Workshop Leads
Online

Thursday, 29 October

1020 - 1030 EDT Introduction to Day 3
Dr. Marv King, Workshop Chair
Online

1030 - 1200 EDT Working Group Break-Out for Discussion
Workshop Leads
Online

1200 - 1330 EDT Lunch

1330 - 1500 EDT Synthesis Observations and Possible “Path Ahead”
Mr. Greg Keethler, Synthesis Chair
Online

1500 - 1530 EDT Break

1530 - 1700 EDT Closing Remarks and “Hot Wash”
Dr. Marv King, Working Group Chairs, and Synthesis Chair
Online

Tracks

Working Group #1: Cyber Metric Assessment

Chair: Ms. Kate Buckley

Working group 1 will focus on specific metrics and how to collect and consolidate data for cybersecurity operations. We encourage participation from the DoD Information Network, the Department of Homeland Security’s (DHS) Cybersecurity Infrastructure Security Agency (CISA), Defense Industrial Base (DIB), other US Government (USG), and industry interested in cybersecurity assessment and metrics. Linkages to strategic assessment and the specific metrics passed from operational to strategic levels should also be addressed in presentation and discussion.

Working Group #2: Information Operations Assessment

Chair: Mr. Chuck Burdick

Working group 2 will focus on developing assessment tools and techniques to address information operations. This WG will consider operational vignettes from Combat Training Centers, ongoing exercises, and other sources, as well as analytic tools for new organizations to conduct analysis and assessment. We encourage participation from organizations and individuals from the Combat Training Centers and those actively involved in ongoing exercises, as well as DHS/CISA. Linkages to strategic assessment and the specific metrics passed from operational to strategic should also be addressed in presentation and discussion.

Working Group #3: National Level Assessment

Chair: Mr. Kyle Wilkinson

Working group 3 will focus on assessment metrics addressing the national strategic level of Cyberspace Operations (CO) and IO. CO and IO impact the full competition continuum from cooperation to competition below armed conflict to armed conflict. Similarly, both also have visible effects on all arms of national policy expressed by the DIMEFIL (Diplomatic, Information, Military, Economic, Financial, Intelligence and Law Enforcement) model. Metrics should consider how to measure the impact of CO and IO across a range of national strategy concepts. The mapping between proposed assessment metrics and available data should also be addressed. We encourage participation from the DoD Information Network, the DHS CISA, DIB, other USG, and industry interested in CO and IO assessment metrics at the strategic level.

Working Group #4: Data Collection Efforts

Working Group 4 will focus on the collection and use of existing and proposed datasets for both open-source publication and USG-only use. We encourage participation from USG and industry cybersecurity and information warfare assessment centers of excellence and others actively conducting these assessments.

Registration

Payment Options

The "Invoice Me" option can only be used for the registration fee. This option won't appear if you have social tickets, CEU courses or tutorials in your cart. If you need assistance registering please contact Ms. Tina Yan, tina.yan@mors.org.

   Member Non-Member
MORS Sponsor  $225
 $275
U.S. Federal Government  $250  $300
National Research Partner
(IDA Employees Only)
 $261  $309
 All Others  $275  $325