TY - JOUR
T1 - Designing Efficient and Lightweight Deep Learning Models for Healthcare Analysis
AU - Baltabay, Mereke
AU - Yazici, Adnan
AU - Sterling, Mark
AU - Ever, Enver
N1 - Funding Information:
This work was funded by NU Faculty-development competitive research grants program, Nazarbayev University, Grant Number-110119FD4543. We would like to thank the researchers in Multimedia Lab at NU for their contributions.
Publisher Copyright:
© 2023, The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature.
PY - 2023
Y1 - 2023
N2 - The application of classification and prediction algorithms in healthcare can facilitate the detection of specific vital signs, which can be used to treat or prevent disease. In this study, a new framework based on deep learning architectures is introduced for the human activity recognition. Our proposed framework uses biosensors, electrocardiography (ECG) sensors, inertial sensors, and small single-board computers to collect and analyse sensory information. ECG and inertial sensory information is converted to images, and novel preprocessing techniques are used effectively. We use convolutional neural networks (CNN) along with sensor fusion, random forest, and long short-term memory (LSTM) with gated recurrent unit (GRU). The evaluation of the proposed approaches is carried out by considering well-known models such as transfer learning with MobileNet, CNN+MobileNet combined, and support vector machine in terms of accuracy. Moreover, the effects of the Null class, which are commonly seen in popular health-related datasets, are also investigated. The results show that LSTM with GRU, RandomForest and CNN with sensor fusion provided the highest accuracies with 99%, 98% and 98%, respectively. Since edge computing using sensors with relatively limited processing power and capacities has recently become quite common, a comparison is also provided to show the efficiency and edge computability of the architectures proposed in this study. The number of parameters used, the size of the models, and the training times as well as the testing times are evaluated and compared. The random forest algorithm provides the best training and testing time results, while models of LSTM with GRU have the smallest model size.
AB - The application of classification and prediction algorithms in healthcare can facilitate the detection of specific vital signs, which can be used to treat or prevent disease. In this study, a new framework based on deep learning architectures is introduced for the human activity recognition. Our proposed framework uses biosensors, electrocardiography (ECG) sensors, inertial sensors, and small single-board computers to collect and analyse sensory information. ECG and inertial sensory information is converted to images, and novel preprocessing techniques are used effectively. We use convolutional neural networks (CNN) along with sensor fusion, random forest, and long short-term memory (LSTM) with gated recurrent unit (GRU). The evaluation of the proposed approaches is carried out by considering well-known models such as transfer learning with MobileNet, CNN+MobileNet combined, and support vector machine in terms of accuracy. Moreover, the effects of the Null class, which are commonly seen in popular health-related datasets, are also investigated. The results show that LSTM with GRU, RandomForest and CNN with sensor fusion provided the highest accuracies with 99%, 98% and 98%, respectively. Since edge computing using sensors with relatively limited processing power and capacities has recently become quite common, a comparison is also provided to show the efficiency and edge computability of the architectures proposed in this study. The number of parameters used, the size of the models, and the training times as well as the testing times are evaluated and compared. The random forest algorithm provides the best training and testing time results, while models of LSTM with GRU have the smallest model size.
KW - Biosensors
KW - Convolutional neural network (CNN)
KW - Healthcare systems
KW - Internet of things (IoT)
KW - Transfer learning
UR - http://www.scopus.com/inward/record.url?scp=85150596763&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85150596763&partnerID=8YFLogxK
U2 - 10.1007/s11063-023-11246-9
DO - 10.1007/s11063-023-11246-9
M3 - Article
AN - SCOPUS:85150596763
SN - 1370-4621
JO - Neural Processing Letters
JF - Neural Processing Letters
ER -