AI assisted reader evaluation in acute CT head interpretation (AI-REACT): protocol for a multireader multicase study
Journal article
Howell Fu, Alex Novak, Dennis Robert, Shamie Kumar, Swetha Tanamala, Jason Oke, Kanika Bhatia, Ruchir Shah, Andrea Romsauerova, Tilak Das, Abdalá Espinosa, Mariusz Tadeusz Grzeda, Mariapaola Narbone, Rahul Dharmadhikari, Mark Harrison, Kavitha Vimalesvaran, Jane Gooch, Nicholas Woznitza, Nabeeha Salik, Alan Campbell, Farhaan Khan, David J Lowe, Haris Shuaib and Sarim Ather 2024. AI assisted reader evaluation in acute CT head interpretation (AI-REACT): protocol for a multireader multicase study. BMJ Open. 14 (2), p. e079824. https://doi.org/10.1136/bmjopen-2023-079824
Authors | Howell Fu, Alex Novak, Dennis Robert, Shamie Kumar, Swetha Tanamala, Jason Oke, Kanika Bhatia, Ruchir Shah, Andrea Romsauerova, Tilak Das, Abdalá Espinosa, Mariusz Tadeusz Grzeda, Mariapaola Narbone, Rahul Dharmadhikari, Mark Harrison, Kavitha Vimalesvaran, Jane Gooch, Nicholas Woznitza, Nabeeha Salik, Alan Campbell, Farhaan Khan, David J Lowe, Haris Shuaib and Sarim Ather |
---|---|
Abstract | Introduction A non-contrast CT head scan (NCCTH) is the most common cross-sectional imaging investigation requested in the emergency department. Advances in computer vision have led to development of several artificial intelligence (AI) tools to detect abnormalities on NCCTH. These tools are intended to provide clinical decision support for clinicians, rather than stand-alone diagnostic devices. However, validation studies mostly compare AI performance against radiologists, and there is relative paucity of evidence on the impact of AI assistance on other healthcare staff who review NCCTH in their daily clinical practice. Methods and analysis A retrospective data set of 150 NCCTH will be compiled, to include 60 control cases and 90 cases with intracranial haemorrhage, hypodensities suggestive of infarct, midline shift, mass effect or skull fracture. The intracranial haemorrhage cases will be subclassified into extradural, subdural, subarachnoid, intraparenchymal and intraventricular. 30 readers will be recruited across four National Health Service (NHS) trusts including 10 general radiologists, 15 emergency medicine clinicians and 5 CT radiographers of varying experience. Readers will interpret each scan first without, then with, the assistance of the qER EU 2.0 AI tool, with an intervening 2-week washout period. Using a panel of neuroradiologists as ground truth, the stand-alone performance of qER will be assessed, and its impact on the readers’ performance will be analysed as change in accuracy (area under the curve), median review time per scan and self-reported diagnostic confidence. Subgroup analyses will be performed by reader professional group, reader seniority, pathological finding, and neuroradiologist-rated difficulty. Ethics and dissemination The study has been approved by the UK Healthcare Research Authority (IRAS 310995, approved 13 December 2022). The use of anonymised retrospective NCCTH has been authorised by Oxford University Hospitals. The results will be presented at relevant conferences and published in a peer-reviewed journal. |
Keywords | AI; Artificial intelligence; CT scans; CT head scans; Radiology and imaging |
Year | 2024 |
Journal | BMJ Open |
Journal citation | 14 (2), p. e079824 |
Publisher | BMJ Publishing Group |
ISSN | 2044-6055 |
Digital Object Identifier (DOI) | https://doi.org/10.1136/bmjopen-2023-079824 |
Official URL | https://bmjopen.bmj.com/content/14/2/e079824 |
Funder | NIHR |
Publication dates | |
12 Feb 2024 | |
Publication process dates | |
Accepted | 28 Jan 2024 |
Deposited | 21 Feb 2024 |
Publisher's version | License File Access Level Open |
Output status | Published |
Additional information | Trial registration number NCT06018545. |
https://repository.canterbury.ac.uk/item/97237/ai-assisted-reader-evaluation-in-acute-ct-head-interpretation-ai-react-protocol-for-a-multireader-multicase-study
Download files
48
total views26
total downloads3
views this month0
downloads this month