Digital mammographic interpretation by UK radiographer mammographers: A JAFROC analysis of observer performance
Journal article
Williams, S., Aksoy, U., Reed, W., Cielecki, L. and Woznitza, N. 2021. Digital mammographic interpretation by UK radiographer mammographers: A JAFROC analysis of observer performance. Radiography. https://doi.org/10.1016/j.radi.2021.02.015
Authors | Williams, S., Aksoy, U., Reed, W., Cielecki, L. and Woznitza, N. |
---|---|
Abstract | Introduction: Radiologists utilise mammography test sets to bench mark their performance against recognised standards. Using a validated test set, this study compares the performance of radiographer readers against previous test results for radiologists. Methods: Under similar test conditions radiographer readers were given an established test set of 60 mammograms and tasked to identify breast cancer, they were measured against their ability to identify, locate and give a confidence level for cancer being present on a standard set of mammographic images. The results were then compared to previously published results for radiologists for similar or the same test sets. Results: The 10 radiographer readers demonstrated similar results to radiologists and for lesion sensitivity were the highest scoring group. The study group score a sensitivity of 83; a specificity of 69.3 and lesion sensitivity of 74.8 with ROC and JAFROC scores of 0.86 and 0.74 respectively. Conclusion: Under test conditions radiographers are able to identify and accurately locate breast cancer in a range of complex mammographic backgrounds. Implications for practice: The study was performed under experimental conditions with results comparable to breast radiologists under similar conditions; translation of these findings into clinical practice will help address access and capacity issues in the timely identification and diagnosis of breast cancer. |
Keywords | Radiographer reader; Mammography; Breast cancer; Lmage interpretation; Sensitivity; Specificity; Observer performance; ROC |
Year | 2021 |
Journal | Radiography |
Publisher | Elsevier |
ISSN | 1078-8174 |
1532-2831 | |
Digital Object Identifier (DOI) | https://doi.org/10.1016/j.radi.2021.02.015 |
Official URL | https://doi.org/10.1016/j.radi.2021.02.015 |
Funder | College of Radiographers |
Publication dates | |
Online | 17 Mar 2021 |
Publication process dates | |
Accepted | 27 Feb 2021 |
Deposited | 12 Apr 2021 |
Accepted author manuscript | License File Access Level Open |
Output status | Published |
https://repository.canterbury.ac.uk/item/8x70w/digital-mammographic-interpretation-by-uk-radiographer-mammographers-a-jafroc-analysis-of-observer-performance
Download files
88
total views142
total downloads1
views this month2
downloads this month
Export as
Related outputs
An implementation facilitation intervention to improve the musculoskeletal X‑ray reporting by radiographers across London
Lockwood, P., Burton, C., Shaw, T., Woznitza, N., Compton, E., Groombridge, H., Hayes, N., Mane, U., O'Brien, A. and Patterson, S. 2025. An implementation facilitation intervention to improve the musculoskeletal X‑ray reporting by radiographers across London. BMC Health Services Research. 25 (248), p. 1. https://doi.org/10.1186/s12913-025-12356-xAccuracy of interpretation of nasogastric tube position on chest radiographs by diagnostic radiographers: A multi-case, multi-reader study
Creeden, A., McFadden, S., Ather, S. and Woznitza, N. 2025. Accuracy of interpretation of nasogastric tube position on chest radiographs by diagnostic radiographers: A multi-case, multi-reader study. Radiography. 31 (1), pp. 83-88. https://doi.org/10.1016/j.radi.2024.10.022Achieving earlier diagnosis of symptomatic lung cancer
Bradley, S., Baldwin, D., Bhartia, B., Black, G., Callister, Matthew Ej, Clayton, Karen, Eccles, Sinan R, Evison, Matthew, Fox, Jesme, Hamilton, W., Konya, J., Lee, Richard W, Bradley, S., Navani, Neal, Noble, Ben, Quaife, Samantha L, Randle, Amelia, Rawlinson, Janette, Richards, Michael, Woznitza, Nick and O'Dowd, Emma 2024. Achieving earlier diagnosis of symptomatic lung cancer. The British Journal of General Practice : The Journal of the Royal College of General Practitioners. 75 (750), pp. 40-43. https://doi.org/10.3399/bjgp25X740493Artificial intelligence (AI) for paediatric fracture detection: a multireader multicase (MRMC) study protocol.
Shelmerdine, S., Pauling, Cato, Allan, Emma, Langan, Dean, Ashworth, Emily, Yung, Ka-Wai, Barber, Joy, Haque, Saira, Rosewarne, David, Woznitza, N., Ather, S., Novak, A., Theivendran, Kanthan and Arthurs, O. 2024. Artificial intelligence (AI) for paediatric fracture detection: a multireader multicase (MRMC) study protocol. BMJ Open. 14 (12), p. e084448. https://doi.org/10.1136/bmjopen-2024-084448Evaluating the impact of artificial intelligence-assisted image analysis on the diagnostic accuracy of front-line clinicians in detecting fractures on plain X-rays (FRACT-AI): protocol for a prospective observational study.
Novak, A., Hollowday, Max, Espinosa Morgado, A., Oke, Jason, Shelmerdine, S., Woznitza, N., Metcalfe, David, Costa, Matthew L, Wilson, S., Kiam, Jian Shen, Vaz, J., Limphaibool, N., Ventre, Jeanne, Jones, Daniel, Greenhalgh, Lois, Gleeson, Fergus, Welch, Nick, Mistry, Alpesh, Devic, Natasa, Teh, James and Ather, S. 2024. Evaluating the impact of artificial intelligence-assisted image analysis on the diagnostic accuracy of front-line clinicians in detecting fractures on plain X-rays (FRACT-AI): protocol for a prospective observational study. BMJ Open. 14 (9), p. e086061. https://doi.org/10.1136/bmjopen-2024-086061A survey of the NHS reporting radiographer workforce in England
Lockwood, P., Burton, C., Shaw, T. and Woznitza, N. 2024. A survey of the NHS reporting radiographer workforce in England. Radiography Open. 10 (1), pp. 1-18. https://doi.org/10.7577/radopen.5635Reporting radiographers within the European Federation of Radiographer Society (EFRS) member countries - motivation for becoming a reporting radiographer.
Jensen, J, Blackburn, P A, Gale, N, Senior, C, Woznitza, N, Heales, C J and Pedersen, M R V 2024. Reporting radiographers within the European Federation of Radiographer Society (EFRS) member countries - motivation for becoming a reporting radiographer. Radiography. 30 (3), pp. 731-736. https://doi.org/S1078-8174(24)00055-5AI assisted reader evaluation in acute CT head interpretation (AI-REACT): protocol for a multireader multicase study
Howell Fu, Alex Novak, Dennis Robert, Shamie Kumar, Swetha Tanamala, Jason Oke, Kanika Bhatia, Ruchir Shah, Andrea Romsauerova, Tilak Das, Abdalá Espinosa, Mariusz Tadeusz Grzeda, Mariapaola Narbone, Rahul Dharmadhikari, Mark Harrison, Kavitha Vimalesvaran, Jane Gooch, Nicholas Woznitza, Nabeeha Salik, Alan Campbell, Farhaan Khan, David J Lowe, Haris Shuaib and Sarim Ather 2024. AI assisted reader evaluation in acute CT head interpretation (AI-REACT): protocol for a multireader multicase study. BMJ Open. 14 (2), p. e079824. https://doi.org/10.1136/bmjopen-2023-079824Reporting radiographers in Europe survey: An overview of the role within the European Federation of Radiographer Society (EFRS) member countries
Pedersen, M.R. V., Jensen, J., Senior, C., Gale, N., Heales, C. J. and Woznitza, N. 2023. Reporting radiographers in Europe survey: An overview of the role within the European Federation of Radiographer Society (EFRS) member countries. Radiography. 29 (6), pp. 1100-1107. https://doi.org/10.1016/j.radi.2023.09.005Assessing the barriers and enablers to the implementation of the diagnostic radiographer musculoskeletal X‑ray reporting service within the NHS in England: a systematic literature review
Lockwood, P., Burton, C., Woznitza, N. and Shaw, T. 2023. Assessing the barriers and enablers to the implementation of the diagnostic radiographer musculoskeletal X‑ray reporting service within the NHS in England: a systematic literature review. BMC Health Services Research. 23 (1270), pp. 1-41. https://doi.org/10.1186/s12913-023-10161-y