A Study to Assess the Impact of an Artificial Intelligence (AI) System on Chest X-ray Reporting

The study has an initial short retrospective component but is predominately a prospective study with two main parts. Initially during a 1 month period whilst reporters are familiarising themselves with the software two local databases will be reviewed by the AI software: * A training set of 100 chest X-rays (CXR) some of which contain nodules and is used as a training tool with previously documented radiologist performance. * A set of previously reported radiographs in patients referred by the reporter for CT, ground truth created from the prior CT report and review by two radiologists if required. This will allow comparison of stand-alone radiologist and AI performance This is followed by a 6 month period involving multiple groups of reporters and approximately 20,000 cases looking at the impact of an AI system which assesses 10 abnormalities on chest X-ray and reporting on the sensitivity for detection of lesions and its impact on reporter confidence. Specifically the investigators would look at: * Missed finding by AI, but detected by reporter * Correctly detected finding by AI * Missed finding by the reporter but detected by AI * Finding detected by AI but disputed by the reporter ■ AI's impact on * Radiological report * Further recommended imaging * Altering patient management * improvement in report confidence as perceived by reporter A subsequent 3 month period looking at the impact of AI produced worklists on report turnaround times and the patient pathway from chest X-ray to CT. the investigators would specifically look at: * number of nodules detected * number of CXRs recommended for follow up CT * time taken from CXR to CT * number of lung cancers detected after CT\[1\] * Time to report, measured as previously from PACS and reporting software data The population to be studied will be all patients over 16 years of age referred by their General Practitioner to Hull University Hospitals NHS Trust for a chest radiograph and any chest radiograph performed in the Hull Royal Infirmary ED radiology for patients over 16 years of age during the 6 month study period. The ED department images patients from the emergency department and in-patients within the hospital. All radiographs will be reviewed initially without review of the AI information and then using the additional images. Reporters will mark the effect of the AI on their decision. All disagreements between the reporter and the AI will be reviewed by senior reporters and a consensus decision made.

Sex

All

Minimum age

16 Years

Inclusion Criteria:

* patient 16 years or older
* Posterior-anterior and Anterior-posterior chest radiographs
* Requested by General Practitioners or performed in the Emergency Department radiology unit

Exclusion Criteria:

* Patients under 16 years of age
* lateral films
* Chest radiographs which are of suboptimal quality, to an extent that it is deemed uninterpretable by the reporter

• BACKGROUNDTurkington PM, Kennan N, Greenstone MA. Misinterpretation of the chest x ray as a factor in the delayed diagnosis of lung cancer. Postgrad Med J. 2002 Mar;78(917):158-60. doi: 10.1136/pmj.78.917.158. PMID 11884698
• BACKGROUNDJang S, Song H, Shin YJ, Kim J, Kim J, Lee KW, Lee SS, Lee W, Lee S, Lee KH. Deep Learning-based Automatic Detection Algorithm for Reducing Overlooked Lung Cancers on Chest Radiographs. Radiology. 2020 Sep;296(3):652-661. doi: 10.1148/radiol.2020200165. Epub 2020 Jul 21. PMID 32692300
• BACKGROUNDNam JG, Park S, Hwang EJ, Lee JH, Jin KN, Lim KY, Vu TH, Sohn JH, Hwang S, Goo JM, Park CM. Development and Validation of Deep Learning-based Automatic Detection Algorithm for Malignant Pulmonary Nodules on Chest Radiographs. Radiology. 2019 Jan;290(1):218-228. doi: 10.1148/radiol.2018180237. Epub 2018 Sep 25. PMID 30251934
• BACKGROUNDHwang EJ, Park S, Jin KN, Kim JI, Choi SY, Lee JH, Goo JM, Aum J, Yim JJ, Cohen JG, Ferretti GR, Park CM; DLAD Development and Evaluation Group. Development and Validation of a Deep Learning-Based Automated Detection Algorithm for Major Thoracic Diseases on Chest Radiographs. JAMA Netw Open. 2019 Mar 1;2(3):e191095. doi: 10.1001/jamanetworkopen.2019.1095. PMID 30901052
• BACKGROUNDHwang EJ, Lee JH, Kim JH, Lim WH, Goo JM, Park CM. Deep learning computer-aided detection system for pneumonia in febrile neutropenia patients: a diagnostic cohort study. BMC Pulm Med. 2021 Dec 7;21(1):406. doi: 10.1186/s12890-021-01768-0. PMID 34876075
• BACKGROUNDJones CM, Danaher L, Milne MR, Tang C, Seah J, Oakden-Rayner L, Johnson A, Buchlak QD, Esmaili N. Assessment of the effect of a comprehensive chest radiograph deep learning model on radiologist reports and patient outcomes: a real-world observational study. BMJ Open. 2021 Dec 20;11(12):e052902. doi: 10.1136/bmjopen-2021-052902. PMID 34930738