William Avis,* Kaitlin Ball, Katherine Cheeseman, James Georgalakis, Sian Herbert, Iffat Idris, Zenobia Ismail, Brian Lucas, Shreya Jose Maliakal, Jasmin Morris, Sithandiwe Mujuru, Evert-Jan Quak, Sarah Verhaeg, and Mahdi Zaidan.
Abstract: This study presents findings from a pilot study conducted under the Knowledge for
Development and Diplomacy (K4DD) programme, commissioned by the UK Foreign, Commonwealth and Development Office (FCDO). The study evaluated the effectiveness, efficiency, and ethical implications of using artificial intelligence (AI) tools in producing rapid evidence synthesis products. Three categories of AI tools (generative AI chat, research assistants, and systematic review tools) were tested across nineteen K4DD outputs. While results reveal that AI tools offer promise, particularly in early-stage research, their current utility in responding to complex, multifaceted research queries remains limited. The study concludes with recommendations for researchers, programmes, and institutions to guide ethical, effective and appropriate AI integration.
Policy relevance: This study provides policymakers with an evidence‑based assessment of the
role of emerging AI research tools in the delivery of rapid evidence synthesis products for time‑sensitive development and diplomacy decisions. It offers practical insights to guide responsible adoption, risk management, and future integration of AI within evidence‑informed policy processes.
Keywords: artificial intelligence (AI), knowledge for development, rapid evidence review,
research tools, ethics, large language models
Authors: William Avis, University of Birmingham: w.r.avis@bham.ac.uk. Kaitlin Ball,
(independent). Katherine Cheeseman, Institute of Development Studies. James Georgalakis,
Institute of Development Studies. Sian Herbert, University of Birmingham. Iffat Idris, University
of Birmingham. Zenobia Ismail, University of Birmingham. Brian Lucas, University of
Birmingham. Shreya Jose Maliakal, Institute of Development Studies. Jasmin Morris, Institute
of Development Studies. Sithandiwe Mujuru, University of Birmingham. Evert-Jan Quak,
Institute of Development Studies. Sarah Verhaeg, University of Birmingham. Mahdi Zaidan,
Institute of Development Studies.
Acknowledgements: This research was funded by the UK Foreign, Commonwealth and
Development Office (FCDO) under the Knowledge for Development and Diplomacy programme
(K4DD).
DOI: https://doi.org/10.48352/uobxgsdrc.0005
