Artificial intelligence (AI) can detect and diagnose cancer on breast ultrasound with accuracy comparable to that of radiologists, according to research presented Monday at the 2021 virtual annual meeting of the American Roentgen Ray Society (ARRS).
A research team from New York University trained its own AI algorithm to automatically detect and classify breast lesions on ultrasound without manual annotation from radiologists. The team also said that AI systems such as this can help human imagers make more accurate diagnoses.
"We believe this work highlights the promise that deep learning and AI might hold for improving breast cancer detection using breast ultrasound," said Jamie Oliver, a medical student at New York University.
Breast ultrasound is an important tool in the detection of breast masses. While studies have shown that the technique can consistently detect additional cancers when used as a supplemental screening modality, it is prone to false positives and has lower sensitivity compared with breast MRI.
The NYU team trained its AI model using its large-scale, institutional dataset of 345,370 breast ultrasound exams acquired from 168,282 patients between 2012 and 2019.
The team then tested the algorithm alongside 13 human imaging readers with varied expertise. Each reader reviewed 250 breast ultrasound exams that were randomly sampled from the test set. A hybrid decision-making model was then created for each reader, which made predictions by evenly weighting the predictions of the reader and the AI system.
Among the exams included in the study, 392 breasts were imaged, 38 of which had malignant lesions.
The AI model achieved an area under the receiver operating characteristic (AUC) of 0.880, significantly outperforming each of the 13 readers (p < 0.01). The performances of the human readers achieved 0.818 AUC on average, none of which exceeded the AI model's performance.
However, the accuracy of the readers improved with the help of AI. The hybrid predictions of each reader and the AI algorithm improved the average diagnostic accuracy for all readers, including attending radiologists and trainees, to 0.852 AUC (p < 0.01).
| Accuracy of breast ultrasound with and without AI assistance | ||
| Average AUC without AI assistance | Average AUC with AI assistance | |
| Radiologists | 0.824 | 0.863 |
| Trainees | 0.805 | 0.826 |
"If incorporated as a decision-support tool, we believe that AI has the potential to improve the diagnostic accuracy of breast ultrasound and significantly decrease the number of benign biopsies performed," Oliver said.
The team is also optimistic that such an AI system can serve as a valuable aid in clinical decision-making in areas with reduced resources, including where there might be shortages of radiologists.
