Abstract
Advances in artificial intelligence (AI) bring new opportunities and hold exciting potential for both intelligence production and assessment, helping to surface new intelligence insights and boosting productivity. AI is not new to GCHQ or the intelligence assessment community. But the accelerating pace of change is. In an increasingly contested and volatile world, we need to continue to exploit AI to identify threats and emerging risks, alongside our important contribution to ensuring AI safety and security.
Across intelligence production and all-source assessment, AI can help to surface new insights and ensure that our analysts can access, at speed, a far greater range of data and information. We must harness the potential of AI to make sense of the ever-expanding volume of material which can inform our assessments. If we don't, we risk drowning in data and failing to spot emerging risks or trends as a result.
At the same time, advances in AI bring some new challenges for intelligence production and assessment. Questions of bias, robustness, and source validation apply just as much to AI systems as they do to the more traditional sources of insight.
This welcome, groundbreaking report explores some of the ways in which we may need to adapt our intelligence system to successfully integrate AI tools into our work. And it seeks to answer the difficult question of what needs to be in place for AI-enriched insights to be used effectively and wisely in the assessments which inform National Security decisions.
We are grateful to the Alan Turing Institute's Centre for Emerging Technology and Security (CETaS) for helping us explore this important issue, and to the large number of people across Government who have contributed to this research.
This CETaS Research Report presents the findings of a project commissioned by the Joint Intelligence Organisation (JIO) and GCHQ, on the topic of artificial intelligence (AI) and strategic decision-making. The report assesses how AI-enriched intelligence should be communicated to strategic decision-makers in government to ensure the principles of analytical rigour, transparency, and reliability of intelligence reporting and assessment are upheld. The findings are based on extensive primary research across UK assessment bodies, intelligence agencies, and other government departments. Intelligence assessment functions have a significant challenge to identify, process, and analyse exponentially growing sources and quantities of information. The research found that AI is a valuable analytical tool for all-source intelligence analysts and failing to adopt AI tools could undermine the authority and value of all-source intelligence assessments to government. However, the use of AI could both exacerbate known risks in intelligence work such as bias and uncertainty, and make it difficult for analysts to evaluate and communicate the limitations of AI-enriched intelligence. A key challenge for the assessment community will be maximising the opportunities and benefits of AI, while mitigating any risks. To embed best practice when communicating AI-enriched intelligence to decision-makers, the report recommends the development of standardised terminology for communicating AI-related uncertainty; new training for intelligence analysts and strategic decision-makers; and an accreditation programme for AI systems used in intelligence analysis and assessment.