TY - GEN
T1 - Few-Shot Learning based on Residual Neural Networks for X-ray Image Classification
AU - Abdrakhmanov, Rakhat
AU - Viderman, Dmitriy
AU - Wong, Kok Seng
AU - Lee, Minho
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - Currently, deep learning is widely used in the field of medicine, which in turn includes radiology. This paper considers the problem of the classification of X-ray images and the lack of images of specific classes. The classes included COVID-19 and Normal X-ray scans. To solve the problems, we propose few-shot learning that is based on different Residual Convolutional Neural Network models with different complexities. The method is designed for the datasets that have small amount of samples of a specific class and a larger amount of instances of another class. The utilization of few-shot learning can solve the issues of the balance of X-ray datasets. The Residual Convolutional Neural Network models we used are as follows: ResNet-50, ResNet-101, and ResNet-152. The architectures had been used to extract the features from the images that were used later. The latter model has the highest complexity, while the former has the lowest complexity, respectively. The obtained results include the highest accuracy of 97.7% for 10 shots of COVID-19 positive X-ray images. The accuracy was achieved using ResNet-101 model. The highest result for ResNet-152 model was 95.6 %. However, on average, the model achieved the highest accuracy. ResNet-50 model provided the least accurate results, however, it is less complex which provides faster performance. One can also notice that with the higher number of COVID-19 positive shots that were used for training, the accuracy also gets higher. To provide transparency to our solution, we furthermore created t-distributed stochastic neighbor embedding visualization. This showed us that the system could separate the two classes into two distinct clusters. Overall, the results imply the efficiency of the solution that was proposed in the study.
AB - Currently, deep learning is widely used in the field of medicine, which in turn includes radiology. This paper considers the problem of the classification of X-ray images and the lack of images of specific classes. The classes included COVID-19 and Normal X-ray scans. To solve the problems, we propose few-shot learning that is based on different Residual Convolutional Neural Network models with different complexities. The method is designed for the datasets that have small amount of samples of a specific class and a larger amount of instances of another class. The utilization of few-shot learning can solve the issues of the balance of X-ray datasets. The Residual Convolutional Neural Network models we used are as follows: ResNet-50, ResNet-101, and ResNet-152. The architectures had been used to extract the features from the images that were used later. The latter model has the highest complexity, while the former has the lowest complexity, respectively. The obtained results include the highest accuracy of 97.7% for 10 shots of COVID-19 positive X-ray images. The accuracy was achieved using ResNet-101 model. The highest result for ResNet-152 model was 95.6 %. However, on average, the model achieved the highest accuracy. ResNet-50 model provided the least accurate results, however, it is less complex which provides faster performance. One can also notice that with the higher number of COVID-19 positive shots that were used for training, the accuracy also gets higher. To provide transparency to our solution, we furthermore created t-distributed stochastic neighbor embedding visualization. This showed us that the system could separate the two classes into two distinct clusters. Overall, the results imply the efficiency of the solution that was proposed in the study.
KW - Computer Vision
KW - COVID-19
KW - Deep Learning
KW - Few-Shot Learning
KW - X-ray
UR - http://www.scopus.com/inward/record.url?scp=85142692122&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85142692122&partnerID=8YFLogxK
U2 - 10.1109/SMC53654.2022.9945469
DO - 10.1109/SMC53654.2022.9945469
M3 - Conference contribution
AN - SCOPUS:85142692122
T3 - Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics
SP - 1817
EP - 1821
BT - 2022 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2022 - Proceedings
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2022 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2022
Y2 - 9 October 2022 through 12 October 2022
ER -