Optimizing CNN hyperparameters with genetic algorithms for face mask usage classification

(1) * Awang Hendrianto Pratomo Mail (Universitas Pembangunan Nasional Veteran Yogyakarta, Indonesia)
(2) Nur Heri Cahyana Mail (Universitas Pembangunan Nasional Veteran Yogyakarta, Indonesia)
(3) Septi Nur Indrawati Mail (Universitas Pembangunan Nasional Veteran Yogyakarta, Indonesia)
*corresponding author

Abstract


Convolutional Neural Networks (CNNs) have gained significant traction in the field of image categorization, particularly in the domains of health and safety. This study aims to categorize the utilization of face masks, which is a vital determinant of respiratory health. Convolutional neural networks (CNNs) possess a high level of complexity, making it crucial to execute hyperparameter adjustment in order to optimize the performance of the model. The conventional approach of trial-and-error hyperparameter configuration often yields suboptimal outcomes and is time-consuming. Genetic Algorithms (GA), an optimization technique grounded in the principles of natural selection, were employed to identify the optimal hyperparameters for Convolutional Neural Networks (CNNs). The objective was to enhance the performance of the model, namely in the classification of photographs into two categories: those with face masks and those without face masks. The convolutional neural network (CNN) model, which was enhanced by the utilization of hyperparameters adjusted by a genetic algorithm (GA), demonstrated a commendable accuracy rate of 94.82% following rigorous testing and validation procedures. The observed outcome exhibited a 2.04% improvement compared to models that employed a trial and error approach for hyperparameter tuning. Our research exhibits exceptional quality in the domain of investigations utilizing Convolutional Neural Networks (CNNs). Our research integrates the resilience of Genetic Algorithms (GA), in contrast to previous studies that employed Convolutional Neural Networks (CNN) or conventional machine learning models without adjusting hyperparameters. This unique approach enhances the accuracy and methodology of hyperparameter tuning in Convolutional Neural Networks (CNNs).

 


Keywords


Face Mask Usage; CNN; Genetic Algorithms ; Hyperparameters Selection

   

DOI

https://doi.org/10.31763/sitech.v4i1.1182
      

Article metrics

10.31763/sitech.v4i1.1182 Abstract views : 495 | PDF views : 141

   

Cite

   

Full Text

Download

References


[1] K. K. Cheng, T. H. Lam, and C. C. Leung, “Wearing face masks in the community during the COVID-19 pandemic: altruism and solidarity,” Lancet, vol. 399, no. 10336, pp. e39–e40, Apr. 2022, doi: https://doi.org/10.1016/S0140-6736(20)30918-1.

[2] L. Bubbico et al., “Community Use of Face Masks against the Spread of COVID-19,” Int. J. Environ. Res. Public Health, vol. 18, no. 6, p. 3214, Mar. 2021, doi: 10.3390/ijerph18063214.

[3] B. Qin and D. Li, “Identifying Facemask-wearing Condition Using Image Super-Resolution with Classification Network to Prevent COVID-19,” pp. 1-15, May 2020, doi: 10.21203/rs.3.rs-28668/v1.

[4] D. J. Carragher and P. J. B. Hancock, “Surgical face masks impair human face matching performance for familiar and unfamiliar faces,” Cogn. Res. Princ. Implic., vol. 5, no. 1, p. 59, Dec. 2020, doi: 10.1186/s41235-020-00258-x.

[5] A. Waheed and J. Shafi, “Successful Role of Smart Technology to Combat COVID-19,” in 2020 Fourth International Conference on I-SMAC (IoT in Social, Mobile, Analytics and Cloud) (I-SMAC), Oct. 2020, pp. 772–777, doi: 10.1109/I-SMAC49090.2020.9243444.

[6] J. Tomás, A. Rego, S. Viciano-Tudela, and J. Lloret, “Incorrect Facemask-Wearing Detection Using Convolutional Neural Networks with Transfer Learning,” Healthcare, vol. 9, no. 8, p. 1050, Aug. 2021, doi: 10.3390/healthcare9081050.

[7] M. Loey, G. Manogaran, M. H. N. Taha, and N. E. M. Khalifa, “A hybrid deep transfer learning model with machine learning methods for face mask detection in the era of the COVID-19 pandemic,” Measurement, vol. 167, p. 108288, Jan. 2021, doi: 10.1016/j.measurement.2020.108288.

[8] G. Kaur et al., “Face mask recognition system using CNN model,” Neurosci. Informatics, vol. 2, no. 3, p. 100035, Sep. 2022, doi: 10.1016/j.neuri.2021.100035.

[9] M. T. Hailesellasie and S. R. Hasan, “MulNet: A Flexible CNN Processor With Higher Resource Utilization Efficiency for Constrained Devices,” IEEE Access, vol. 7, pp. 47509–47524, 2019, doi: 10.1109/ACCESS.2019.2907865.

[10] P. Doke, D. Shrivastava, C. Pan, Q. Zhou, and Y.-D. Zhang, “Using CNN with Bayesian optimization to identify cerebral micro-bleeds,” Mach. Vis. Appl., vol. 31, no. 5, p. 36, Jul. 2020, doi: 10.1007/s00138-020-01087-0.

[11] A. S. Wicaksono and A. Afif, “Hyper Parameter Optimization using Genetic Algorithm on Machine Learning Methods for Online News Popularity Prediction,” Int. J. Adv. Comput. Sci. Appl., vol. 9, no. 12, pp. 263–267, 2018, doi: 10.14569/IJACSA.2018.091238.

[12] Y. Guo, J. Y. Li, and Z. H. Zhan, “Efficient Hyperparameter Optimization for Convolution Neural Networks in Deep Learning: A Distributed Particle Swarm Optimization Approach,” Cybern. Syst., vol. 52, no. 1, pp. 36–57, 2020, doi: 10.1080/01969722.2020.1827797.

[13] R. J. Borgli, H. Kvale Stensland, M. A. Riegler, and P. Halvorsen, “Automatic Hyperparameter Optimization for Transfer Learning on Medical Image Datasets Using Bayesian Optimization,” in 2019 13th International Symposium on Medical Information and Communication Technology (ISMICT), May 2019, vol. 2019-May, pp. 1–6, doi: 10.1109/ISMICT.2019.8743779.

[14] W. Y. Lee, S. M. Park, and K. B. Sim, “Optimal hyperparameter tuning of convolutional neural networks based on the parameter-setting-free harmony search algorithm,” Opt. - Int. J. Light Electron Opt., vol. 172, no. July, pp. 359–367, 2018, doi: 10.1016/j.ijleo.2018.07.044.

[15] N. Gorgolis, I. Hatzilygeroudis, Z. Istenes, and L. N. G. Gyenne, “Hyperparameter Optimization of LSTM Network Models through Genetic Algorithm,” 10th Int. Conf. Information, Intell. Syst. Appl. IISA 2019, vol. 00, no. c, pp. 1–4, 2019, doi: 10.1109/IISA.2019.8900675.

[16] C. Agarwal, I. Kaur, and S. Yadav, “Hybrid CNN-SVM Model for Face Mask Detector to Protect from COVID-19,” in Lecture Notes in Computational Vision and Biomechanics, vol. 37, Springer Science and Business Media B.V., 2023, pp. 419–426, doi: 10.1007/978-981-19-0151-5_35.

[17] Yang Xu, C. Boone, and L. T. Pileggi, “Metal-mask configurable RF front-end circuits,” IEEE J. Solid-State Circuits, vol. 39, no. 8, pp. 1347–1351, Aug. 2004, doi: 10.1109/JSSC.2004.831798.

[18] S. Zhang, Y. Xue, M. Chen, and S. Niu, “Detection of Face Wearing Mask Based on AdaBoost and YCrCb,” in 2022 4th International Conference on Electrical Engineering and Control Technologies (CEECT), Dec. 2022, pp. 349–353, doi: 10.1109/CEECT55960.2022.10030579.

[19] J. Luengo, D. García-Gil, S. Ramírez-Gallego, S. García, and F. Herrera, “Big Data Preprocessing,” Cham: Springer International Publishing, pp. 1-186, 2020, doi: 10.1007/978-3-030-39105-8.

[20] V. Wiley and T. Lucas, “Computer Vision and Image Processing: A Paper Review,” Int. J. Artif. Intell. Res., vol. 2, no. 1, p. 22, Jun. 2018, doi: 10.29099/ijair.v2i1.42.

[21] R. K. Kodali and R. Dhanekula, “Face Mask Detection Using Deep Learning,” in 2021 International Conference on Computer Communication and Informatics (ICCCI), Jan. 2021, pp. 1–5, doi: 10.1109/ICCCI50826.2021.9402670.

[22] Q. Wang, B. Zhao, H. Ma, J. Chang, and G. Mao, “A method for rapidly evaluating reliability and predicting remaining useful life using two-dimensional convolutional neural network with signal conversion,” J. Mech. Sci. Technol., vol. 33, no. 6, pp. 2561–2571, Jun. 2019, doi: 10.1007/s12206-019-0504-x.

[23] D. M. Hakim and E. Rainarli, “Convolutional Neural Network untuk Pengenalan Citra Notasi Musik,” Techno.Com, vol. 18, no. 3, pp. 214–226, 2019, doi: 10.33633/tc.v18i3.2387.

[24] D. Bhatt et al., “CNN Variants for Computer Vision: History, Architecture, Application, Challenges and Future Scope,” Electronics, vol. 10, no. 20, p. 2470, Oct. 2021, doi: 10.3390/electronics10202470.

[25] A. Lambora, K. Gupta, and K. Chopra, “Genetic Algorithm- A Literature Review,” in 2019 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (COMITCon), Feb. 2019, pp. 380–384, doi: 10.1109/COMITCon.2019.8862255.

[26] S. Mirjalili, “Genetic Algorithm,” in Studies in Computational Intelligence, vol. 780, Springer Verlag, 2019, pp. 43–55, doi: 10.1007/978-3-319-93025-1_4.

[27] T. N. Fatyanosa and M. Aritsugi, “Effects of the Number of Hyperparameters on the Performance of GA-CNN,” in 2020 IEEE/ACM International Conference on Big Data Computing, Applications and Technologies (BDCAT), Dec. 2020, pp. 144–153, doi: 10.1109/BDCAT50828.2020.00016.

[28] M. M. A. Monshi, J. Poon, V. Chung, and F. M. Monshi, “CovidXrayNet: Optimizing data augmentation and CNN hyperparameters for improved COVID-19 detection from CXR,” Comput. Biol. Med., vol. 133, p. 104375, Jun. 2021, doi: 10.1016/j.compbiomed.2021.104375


Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Awang Hendrianto Pratomo

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

___________________________________________________________
Science in Information Technology Letters
ISSN 2722-4139
Published by Association for Scientific Computing Electrical and Engineering (ASCEE)
W : http://pubs2.ascee.org/index.php/sitech
E : sitech@ascee.org, andri@ascee.org, andri.pranolo.id@ieee.org

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0

View My Stats