Cyber Grand Challenge - Infrastructure and Tools
The autonomous systems' performance was measured using the same competition rating metrics used to quantify the performance of human analysts. Competitors successfully created cyber reasoning software that automatically detected and fixed intended and unintended flaws in never-before-seen software at machine speed. The results quantify the systems' ability to reason about and mitigate novel software flaws.
Archived below are the tools that were utilized in the creation and support of this competition, from qualifiers and finals. These materials are available freely for use in research or to assist in hosting a similar event.
Infrastructure and Tools
Qualifying Event Infrastructure
Final Event Infrastructure
Haxxis/TraceAPI work together to generate multiple visualizations from the Cyber Grand Challenge, or other events that utilize the same data format. TraceAPI ingests round bundles that contain all the events from a given round (score data and game events like fielded IDS rules, replacement binaries (RCB), and proofs of vulnerability (POVs)), generates a web dashboard of the round data, and exposes that data via API to Haxxis.
Haxxis uses that data to generate videos, interactively explore game state at a high level, or interactively explore even extremely specific details such as the execution trace of a given combination of IDS, POV, and RCB.
Haxxis is composed of a visualization engine that allows for configurable data pipelines that allow for a wide variety of visualizations to be customized and created, and a video generation server that automates rendering of existing pipelines into videos.
Installation instructions for each package are available in their respective README files.
Downloadable bundles for the challenges, submissions and scores from both the qualifier and final event