Cyber Grand Challenge - Infrastructure and Tools

The goal of the DARPA CGC was to engender a new generation of autonomous cyber defense capabilities that combined the speed and scale of automation with reasoning abilities exceeding those of human experts. Entrants fielded autonomous systems that competed head-to-head in an isolated network testbed environment on the purpose-built operating system DECREE (DARPA Experimental Cyber Research Evaluation Environment).

The autonomous systems' performance was measured using the same competition rating metrics used to quantify the performance of human analysts. Competitors successfully created cyber reasoning software that automatically detected and fixed intended and unintended flaws in never-before-seen software at machine speed. The results quantify the systems' ability to reason about and mitigate novel software flaws.

Archived below are the tools that were utilized in the creation and support of this competition, from qualifiers and finals. These materials are available freely for use in research or to assist in hosting a similar event.

Infrastructure and Tools

Qualifying Event Infrastructure

Final Event Infrastructure

Visualization

Haxxis/TraceAPI work together to generate multiple visualizations from the Cyber Grand Challenge, or other events that utilize the same data format. TraceAPI ingests round bundles that contain all the events from a given round (score data and game events like fielded IDS rules, replacement binaries (RCB), and proofs of vulnerability (POVs)), generates a web dashboard of the round data, and exposes that data via API to Haxxis.

Haxxis uses that data to generate videos, interactively explore game state at a high level, or interactively explore even extremely specific details such as the execution trace of a given combination of IDS, POV, and RCB.

Haxxis is composed of a visualization engine that allows for configurable data pipelines that allow for a wide variety of visualizations to be customized and created, and a video generation server that automates rendering of existing pipelines into videos.

TraceAPI is available for download at https://github.com/Vector35/traceapi/
Haxxis is available for download at https://github.com/voidALPHA/cgc_viz/

Installation instructions for each package are available in their respective README files.

Related Materials

Cyber Grand Challenge Datasets

Downloadable bundles for the challenges, submissions and scores from both the qualifier and final event

Interactive CGC Archive

Cyber Grand Challenge Overview