Logo image
Autonomous Cyber Defence Phase II: Authorised bounds for autonomous agents
Report   Open access

Autonomous Cyber Defence Phase II: Authorised bounds for autonomous agents

Anna Knack and Anthony Burke
CETaS Briefing Papers , The Alan Turing Institute
03/05/2024
DOI:
https://doi.org/10.83162/Turing.82
Appears in  Defense and National Security

Abstract

This CETaS Briefing Paper was commissioned by the UK National Cyber Security Centre (NCSC) and explores different views on the authorisation limits for autonomous agents in network defence, including the contexts within which certain threat containment, eradication and recovery actions should be permissible. This study found that introducing autonomous agents in network defence could introduce potential error risks for almost all tasks on the MITRE D3FEND framework and that the desirable level of autonomy for most contexts in cyber defence converge around systems where autonomous agents can carry out operator initiated pre-set tasks independently within specific conditions under supervision. The study team also found that organisation-specific, context-informed and risk-based analysis is required to determine tailored permissions specifications for autonomous agents that reduce the risk to as low as reasonably practical. Finally, the research investigated the thresholds for ‘net benefit’ and ‘sufficient confidence’ to deploy an AI-based cyber defence system, even if all error risks are not eliminated. Achieving such confidence would require autonomous agents to exhibit a degree of context-specific judgement, and increased reliability compared to current human-led systems – for instance through measurable improvement on cybersecurity outcomes or better understanding of edge cases after the introduction of autonomous agents.
pdf
CETaS briefing_paper_-_autonomous_cyber_defence_-_authorised_bounds_for_autonomous_agents13.20 MBDownloadView
Open Access CC BY V4.0
url
https://cetas.turing.ac.uk/publications/autonomous-cyber-defence-autonomous-agentsView
Published (Version of record) Open CC BY V4.0

Metrics

12 Record Views

Details

Logo image