• Users Online: 14174
  • Print this page
  • Email this page


 
 
Table of Contents
LETTER TO EDITOR
Year : 2021  |  Volume : 4  |  Issue : 3  |  Page : 596-597

Analysis of RetinaNet experiments for COVID-19 detection using computed tomography scan images


Digital Garage Inc., Tokyo, Japan

Date of Submission30-Jul-2021
Date of Decision01-Aug-2021
Date of Acceptance04-Aug-2021
Date of Web Publication10-Sep-2021

Correspondence Address:
Kaustubh Kulkarni
Digital Garage Inc. Tokyo
Japan
Login to access the Email id

Source of Support: None, Conflict of Interest: None


DOI: 10.4103/crst.crst_178_21

Get Permissions


How to cite this article:
Kulkarni K. Analysis of RetinaNet experiments for COVID-19 detection using computed tomography scan images. Cancer Res Stat Treat 2021;4:596-7

How to cite this URL:
Kulkarni K. Analysis of RetinaNet experiments for COVID-19 detection using computed tomography scan images. Cancer Res Stat Treat [serial online] 2021 [cited 2021 Dec 9];4:596-7. Available from: https://www.crstonline.com/text.asp?2021/4/3/596/325905



In this letter, we analyze the paper titled, “Novel artificial intelligence algorithm for automatic detection of COVID-19 abnormalities in computed tomography images” by Bharadwaj et al.[1] which focused on using computed tomography (CT) scan images for diagnosing COVID-19 patients instead of the traditional clinical tests such as real-time polymerase chain reaction.[2] They used a state-of-the-art model framework (RetinaNet) for the task of detection of COVID-19 infection. They tried to overcome the sensitivity issues of traditional clinical tests with the help of a modern deep learning-based image classification approach. They provided sufficient explanation about the methodology and dataset that they have used. We have a few concerns about the overall modeling techniques which we are listing below.


  Was a Pre-Trained Model Used or Not? Top


It would be helpful if the authors could provide the details of the pre-trained models which were used while training the classification model, as was done by Halder and Dutta.[3] We would like to know the performance of the base model itself on the given task without fine-tuning it. This will provide more evidence regarding whether fine-tuning with the dataset curated by the authors really helped with the task.


  Baseline Model Top


We would like the authors to provide details regarding whether they experimented with any baseline model such as a simple convolutional neural network. Providing baseline model performances for comparison with the RetinaNet would be helpful to understand whether this contributed to the performance of the given task.


  Confusion Matrix Top


We would like to learn about the confusion matrix of the classification task, as was described by Shah et al.[4] It would be an interesting addition to the paper itself if the authors could provide more details such as the types of cases in which the model is prone to making mistakes. This will be helpful for medical practitioners in making an informed decision.


  Why Retinanet? Top


We would like to see the comparison with similar kinds of methods where deep learning models have been used for the detection of COVID-19 cases using CT scan images. The authors could apply these methods to the same dataset and report the performance for comparison purposes, as was done by Shah et al. and Qiblawey et al.[4],[5] This analysis is needed to support the authors' decision of using RetinaNet over other models.


  Bias in the Dataset Top


The authors mentioned that they have collected the images of normal people (with no abnormalities) from a tertiary care cancer center. Even though COVID-19-positive data samples were taken without demographic, geographic, or ethnic bias, negative data points might be biased toward a certain group of the population because of issues inherent to the method of data collection. We would like the authors to elaborate on the methods they used to collect these images of COVID-19-negative persons.


  Bounding Box Performance Measures Top


The authors reported that the model draws a bounding box over the infected region in the images as an auxiliary output. We think it is important to report the performance metrics such as Intersection over Union or mean average precision for the bounding box problem as well as to help in understanding the performance of the model. There could be cases where the model prediction is positive and correct, but the bounding box might be drawn at the wrong place. This will help us in understanding whether or not the model is able to correctly locate the abnormalities associated with COVID-19.


  Experiments With Cross-Validation Top


Using cross-validation gives a robust performance over dataset biases and other abnormalities, as was described by Silva et al.[6] We request the authors to provide details about the experiments involving cross-validation which would support the validity of the results.

Financial support and sponsorship

Nil.

Conflicts of interest

There are no conflicts of interest.



 
  References Top

1.
Bharadwaj KS, Pawar V, Punia V, Apparao ML, Mahajan A. Novel artificial intelligence algorithm for automatic detection of COVID-19 abnormalities in computed tomography images. Cancer Res Stat Treat 2021;4:256-61.  Back to cited text no. 1
  [Full text]  
2.
Pande P, Sharma P, Goyal D, Kulkarni T, Rane S, Mahajan A. COVID-19: A review of the ongoing pandemic. Cancer Res Stat Treat 2020;3:221-32.  Back to cited text no. 2
  [Full text]  
3.
Halder A, Dutta B. COVID-19 detection from lung CT-scan images using transfer learning approach. Mach Learn Sci Technol 2021;2:045013.  Back to cited text no. 3
    
4.
Shah V, Keniya R, Shridharani A, Punjabi M, Shah J, Mehendale N. Diagnosis of COVID-19 using CT scan images and deep learning techniques. Emerg Radiol 2021;28:497-505.  Back to cited text no. 4
    
5.
Qiblawey Y, Tahir A, Chowdhury ME, Khandakar A, Kiranyaz S, Rahman T, et al. Detection and severity classification of COVID-19 in CT images using deep learning. Diagnostics (Basel) 2021;11:893.  Back to cited text no. 5
    
6.
Silva P, Luz E, Silva G, Moreira G, Silva R, Lucio D, et al. COVID-19 detection in CT images with deep learning: A voting-based scheme and cross-datasets analysis. Inform Med Unlocked 2020;20:100427.  Back to cited text no. 6
    




 

Top
 
  Search
 
    Similar in PUBMED
   Search Pubmed for
   Search in Google Scholar for
    Access Statistics
    Email Alert *
    Add to My List *
* Registration required (free)  

  Was a Pre-Traine...Bounding Box Per...Experiments With...
  In this article
Baseline Model
Confusion Matrix
Why Retinanet?
Bias in the Dataset
References

 Article Access Statistics
    Viewed238    
    Printed16    
    Emailed0    
    PDF Downloaded17    
    Comments [Add]    

Recommend this journal