A systematic review on the evaluation and characteristics of computer-aided diagnosis systems
Gonçalves, Vagner Mendonça; Delamaro, Márcio Eduardo; Nunes, Fátima Lourdes dos Santos
http://dx.doi.org/10.1590/1517-3151.0517
Rev. Bras. Eng. Bioméd., vol.30, n4, p.355-383, 2014
Downloads: 0
Views: 937
Abstract
Introduction: One of the challenges in developing Computer-Aided Diagnosis (CAD) systems is their accurate
and comprehensive assessment. This paper presents the conduction and results of a systematic review (SR) that
aims to verify the state of the art regarding the assessment of CAD systems. This survey provides a general
analysis of the current status of the design, development and assessment of such systems and includes discussions
on the most used metrics and approaches that could be utilized to obtain more objective evaluation methods.
Methods: The SR was conducted using the scientifi c databases, ACM Digital Library, IEEE Xplore Digital
Library, ScienceDirect and Web of Science. Inclusion and exclusion criteria were defi ned and applied to each
retrieved work to select those of interest. From 156 studies retrieved, 100 studies were included. Results: There
is a number of abnormalities that have been used for the development of CAD systems. Images from computed
tomographies and mammographies are the most encountered types of medical images. Additionally, a number of
studies used public databases for CAD evaluations. The main evaluation metrics and methods applied to CAD
systems include sensitivity, accuracy, specifi city and receiver operating characteristic (ROC) analyses. In the
assessed CAD systems that used the segmentation method, 30.0% applied the overlap measure. Discussion:
There remain several topics to explore for the assessment of CAD schemes. While some evaluation metrics
are traditionally used, they require a prior knowledge of case characteristics to test CAD systems. We were
not able to identify articles that use software testing to evaluate CAD systems. Thus, we realize that there is a
gap between CAD assessments and traditional practices of software engineering. However, the scope of this
research is limited to scientifi c and academic works and excludes commercial interests. Finally, we discuss
potential research studies within this scope to create a more objective and effi cient evaluation of CAD systems.
Keywords
CAD evaluation, Classifi cation, Computer-aided diagnosis, Detection, Medical image,
Segmentation.