Overview
On 11 March 2020, the 2019 National Defense Authorization Act (NDAA) directed Cyberspace Solarium Commission (CRC) Report was released. The CSC was tasked to conduct a bipartisan review of cyber threats to the US and provide strategic guidance and policy recommendations on how to better defend the nation against those threats. The report contains 83 recommendations spread across six pillars.
A key enabling recommendation – 6.1.6: Require Department of Defense to Define Reporting Metrics – will no doubt be part of the 2021 NDAA. The purpose of this MORS Special Meeting is to begin to define these metrics by bringing key players across the cyber domain together to discuss, game plan, and determine a way ahead that incorporates the combined skill and knowledge of the communities. Similar to April 2019’s Urban Operations Special Meeting, a hybrid mini-symposium is planned that will include a group discussion – on the last day – focused on development and refinement of promising metrics. Given the topic, this Special Meeting will at least be restricted to U.S. Government Agencies and their contractors.
Working Groups:
- Working Group #1: Cyber Metric Assessment
- Working Group #2: Information Operations Assessment
- Working Group #3: National Level Assessment
- Working Group #4: Data Collection Efforts
Working Group Topics:
- Tactical and Operational Cyber Assessment
- Tactical and Operational Information Warfare Assessment
- Strategic Assessment
- Use of Existing and Proposed Datasets
Keynot Speaker
Mr. Michael A. Clark
Deputy Director, Plans and Policy (JS) United States Cyber Command (USCYBERCOM)
Mr. Michael Clarke recently serves as a Deputy Director for Plans and Policy. He provides leadership, advice, and technical guidance on cyberspace issues related to the Department of Defense, congressional and presidential positions, operations roles and missions, the development and implementation of international and interagency partnership, policy, national security plans, military strategy, doctrine, and capability requirements supporting the execution of the US CYBERCOM mission.
Confirmed Speakers:
Dr. Erica Borghard
Assistant Professor, Army Cyber Institute United States Military Academy
Mr. Michael A. Clark
Deputy Director, Plans and Policy (JS) United States Cyber Command (USCYBERCOM)
Dr. Emily Goldman
Cyber Strategist and Cyber Persistence SME, U.S. Cyber Command and the National Security Agency
Mr. Jason Healey
Columbia University School of International and Public Affairs
Dr. Ryan Maness
Naval Postgraduate School
Mr. Charles “Bill” Robinson
Joint Force Development and Design Center, Joint Staff (Suffolk) J7
Agenda
Tuesday, 27 October
1030 - 1035 EDT Welcome to MORS Measuring Cyber and IO Workshop
Dr. Marv King, Workshop Chair Online
1035 - 1050 EDT Welcome
CAPT Brian Morgan (Retd.), MORS President
Online
1050 - 1140 EDT Keynote Address
Mr. Michael A. Clark, Deputy Director, Plans and Policy (J5), United States Cyber Command (USCYBERCOM)
Online
1140 - 1200 EDT Workshop Outcomes and Cyber Reporting Metrics
Dr. Marv King, Workshop Chair
Online
1200 - 1330 EDT Lunch
1330 - 1500 EDT Working Group #1 Cyber Metric Assessment
Chairs: Ms. Kate Buckley, Raytheon Technologies and
Dr. Julie A. Steinke, MITRE
Online
- Measuring the Effectiveness of TTP-Based Hunting Methodology: The Problem, the Solution, and the Results
Armand D. Kinslow, MITRE
- Measures of Effectiveness for Determining Effects of Cyber Operations as a Team Sport and Identifying the Measures of Performance as a Team
Julie A. Steinke, MITRE
1500 - 1530 EDT Break
1530 - 1700 EDT Working Group #2 Information Operations Assessment
Chairs: Mr. Chuck Burdick, Innovative Decisions Inc and
Dr. “Fuzzy” Wells, Deputy Director, Institute for Simulation & Training, University of Central Florida
Online
- Tools/Sources to produce Cyber Assessment Results (Cycle of Learning/Research)
Charles “Bill” Robinson, Joint Force Development and Design Center, Joint Staff (Suffolk) J7
- Assessment options in Exercises, Training Data, Tests, and Experiments
Dr. Fuzzy Wells, UCF/IST
- Assessment Options in Simulation & Simulation-Supported/Augmented Wargaming
Mr. Chuck Burdick, IDI
Wednesday, 28 October
1020 - 1030 EDT Introduction to Day 2
Dr. Marv King, Workshop Chair
Online
1030 - 1200 EDT Working Group #3 National Level Assessment
Chair: Mr. Kyle Wilkinson
Online
- Erica Borghard, Assistant Professor, Army Cyber Institute, United States Military Academy
- Measuring to “Reshape the Cyber Ecosystem toward Greater Security” - - Grappling with Federal/State Decentralization
Mr. Benjamin Schechter, US Naval War College
- Persistent Engagement and Strategic Cyber Competition - Implications for Measuring the Effects of Cyber Campaigns
Dr. Emily Goldman, Cyber Strategist and Cyber Persistence SME, U.S. Cyber Command, and the National Security Agency
1200 - 1330 EDT Lunch
1330 - 1500 EDT Working Group #4 Data Collection Efforts- Panel
- Ryan Maness, Naval Postgraduate School
- Jason Healey, Columbia University School of International and Public Affairs
- Marv King, Workshop Chair
Online
1500 - 1530 EDT Break
1530 - 1700 EDT Working Group Break-Out for Discussion
Workshop Leads
Online
Thursday, 29 October
1020 - 1030 EDT Introduction to Day 3
Dr. Marv King, Workshop Chair
Online
1030 - 1200 EDT Working Group Break-Out for Discussion
Workshop Leads
Online
1200 - 1330 EDT Lunch
1330 - 1500 EDT Synthesis Observations and Possible “Path Ahead”
Mr. Greg Keethler, Synthesis Chair
Online
1500 - 1530 EDT Break
1530 - 1700 EDT Closing Remarks and “Hot Wash”
Dr. Marv King, Working Group Chairs, and Synthesis Chair
Online
Tracks
Working Group #1: Cyber Metric Assessment
Chair: Ms. Kate Buckley
Working group 1 will focus on specific metrics and how to collect and consolidate data for cybersecurity operations. We encourage participation from the DoD Information Network, the Department of Homeland Security’s (DHS) Cybersecurity Infrastructure Security Agency (CISA), Defense Industrial Base (DIB), other US Government (USG), and industry interested in cybersecurity assessment and metrics. Linkages to strategic assessment and the specific metrics passed from operational to strategic levels should also be addressed in presentation and discussion.
Working Group #2: Information Operations Assessment
Chair: Mr. Chuck Burdick
Working group 2 will focus on developing assessment tools and techniques to address information operations. This WG will consider operational vignettes from Combat Training Centers, ongoing exercises, and other sources, as well as analytic tools for new organizations to conduct analysis and assessment. We encourage participation from organizations and individuals from the Combat Training Centers and those actively involved in ongoing exercises, as well as DHS/CISA. Linkages to strategic assessment and the specific metrics passed from operational to strategic should also be addressed in presentation and discussion.
Working Group #3: National Level Assessment
Chair: Mr. Kyle Wilkinson
Working group 3 will focus on assessment metrics addressing the national strategic level of Cyberspace Operations (CO) and IO. CO and IO impact the full competition continuum from cooperation to competition below armed conflict to armed conflict. Similarly, both also have visible effects on all arms of national policy expressed by the DIMEFIL (Diplomatic, Information, Military, Economic, Financial, Intelligence and Law Enforcement) model. Metrics should consider how to measure the impact of CO and IO across a range of national strategy concepts. The mapping between proposed assessment metrics and available data should also be addressed. We encourage participation from the DoD Information Network, the DHS CISA, DIB, other USG, and industry interested in CO and IO assessment metrics at the strategic level.
Working Group #4: Data Collection Efforts
Working Group 4 will focus on the collection and use of existing and proposed datasets for both open-source publication and USG-only use. We encourage participation from USG and industry cybersecurity and information warfare assessment centers of excellence and others actively conducting these assessments.
Registration
Payment Options
The "Invoice Me" option can only be used for the registration fee. This option won't appear if you have social tickets, CEU courses or tutorials in your cart. If you need assistance registering please contact Ms. Tina Yan, tina.yan@mors.org.
|
|
Member
|
Non-Member
|
| MORS Sponsor
|
$225
|
$275
|
| U.S. Federal Government
|
$250
|
$300
|
National Research Partner
(IDA Employees Only)
|
$261
|
$309
|
| All Others
|
$275
|
$325
|