YOLOv3 and YOLOv5-based automated facial mask detection and recognition systems to prevent COVID-19 outbreaks

(1) * Md Asifuzzaman Jishan Mail (Faculty of Statistics, Technische Universität Dortmund, Germany)
(2) Ananna Islam Bedushe Mail (Department of Computer Science, Hofstra University, United States)
(3) Md Ataullah Khan Rifat Mail (Faculty of Statistics, Technische Universität Dortmund, Germany)
(4) Bijan Paul Mail (Department of Computer Science and Engineering, University of Liberal Arts Bangladesh, Bangladesh)
(5) Khan Raqib Mahmud Mail (Department of Computer Science and Engineering, University of Liberal Arts Bangladesh, Bangladesh)
*corresponding author

Abstract


Object detection system in light of deep learning have been monstrously effective in complex item identification task images and have shown likely in an extensive variety of genuine applications counting the Coronavirus pandemic. Ensuring and enforcing the proper use of face masks is one of the main obstacles in containing and reducing the spread of the infection among the population. This paper aims to find out how the urban population of a megacity uses facial masks correctly. Using YOLOv3 and YOLOv5, we trained and validated a brand-new dataset to identify images as "with mask", "without mask", and "mask not in position". In the YOLOv3 we carried out three pre-trained models which are: YOLOv3, YOLOv3-tiny, and SPP-YOLOv3. In addition, we utilized five pre-trained models in the YOLOv5: YOLOv5n, YOLOv5s, YOLOv5m, YOLOv5l, and YOLOv5x. The dataset is included 6550 pictures with three classes. On mAP, the dataset achieved a commendable 95% performance accuracy. This research can be used to monitor the proper use of face masks in various public spaces through automated scanning.

   

DOI

https://doi.org/10.31763/sitech.v4i1.1199
      

Article metrics

10.31763/sitech.v4i1.1199 Abstract views : 1122 | PDF views : 179

   

Cite

   

Full Text

Download

References


[1] N.-C. Chiu et al., “Impact of Wearing Masks, Hand Hygiene, and Social Distancing on Influenza, Enterovirus, and All-Cause Pneumonia During the Coronavirus Pandemic: Retrospective National Epidemiological Surveillance Study,” J. Med. Internet Res., vol. 22, no. 8, p. e21257, Aug. 2020, doi: 10.2196/21257.

[2] Y. Kebede, Y. Yitayih, Z. Birhanu, S. Mekonen, and A. Ambelu, “Knowledge, perceptions and preventive practices towards COVID-19 early in the outbreak among Jimma university medical center visitors, Southwest Ethiopia,” PLoS One, vol. 15, no. 5, p. e0233744, May 2020, doi: 10.1371/journal.pone.0233744.

[3] L. Martinelli et al., “Face Masks During the COVID-19 Pandemic: A Simple Protection Tool With Many Meanings,” Front. Public Heal., vol. 8, p. 606635, Jan. 2021, doi: 10.3389/fpubh.2020.606635.

[4] S. Kushwaha et al., “Significant Applications of Machine Learning for COVID-19 Pandemic,” J. Ind. Integr. Manag., vol. 05, no. 04, pp. 453–479, Dec. 2020, doi: 10.1142/S2424862220500268.

[5] S. Lalmuanawma, J. Hussain, and L. Chhakchhuak, “Applications of machine learning and artificial intelligence for Covid-19 (SARS-CoV-2) pandemic: A review,” Chaos, Solitons & Fractals, vol. 139, p. 110059, Oct. 2020, doi: 10.1016/j.chaos.2020.110059.

[6] M. Ivašić-Kos, M. Krišto, and M. Pobar, “Human Detection in Thermal Imaging Using YOLO,” in Proceedings of the 2019 5th International Conference on Computer and Technology Applications, Apr. 2019, vol. Part F1482, pp. 20–24, doi: 10.1145/3323933.3324076.

[7] Z. Cai and N. Vasconcelos, “Cascade R-CNN: High Quality Object Detection and Instance Segmentation,” IEEE Trans. Pattern Anal. Mach. Intell., vol. 43, no. 5, pp. 1483–1498, May 2021, doi: 10.1109/TPAMI.2019.2956516.

[8] K. Bhambani, T. Jain, and K. A. Sultanpure, “Real-time Face Mask and Social Distancing Violation Detection System using YOLO,” in 2020 IEEE Bangalore Humanitarian Technology Conference (B-HTC), Oct. 2020, pp. 1–6, doi: 10.1109/B-HTC50970.2020.9297902.

[9] P. Hurtik, V. Molek, and P. Vlasanek, “YOLO-ASC: You Only Look Once And See Contours,” in 2020 International Joint Conference on Neural Networks (IJCNN), Jul. 2020, pp. 1–7, doi: 10.1109/IJCNN48605.2020.9207223.

[10] M. Vajgl, P. Hurtik, and T. Nejezchleba, “Dist-YOLO: Fast Object Detection with Distance Estimation,” Appl. Sci., vol. 12, no. 3, p. 1354, Jan. 2022, doi: 10.3390/app12031354.

[11] F. Hardan and A. R. J. Almusawi, “Developing an Automated Vision System for Maintaing Social Distancing to Cure the Pandemic,” Al-Khwarizmi Eng. J., vol. 18, no. 1, pp. 38–50, Mar. 2022, doi: 10.22153/kej.2022.03.002.

[12] K. Sengupta and P. R. Srivastava, “HRNET: AI-on-Edge for Mask Detection and Social Distancing Calculation,” SN Comput. Sci., vol. 3, no. 2, p. 157, Mar. 2022, doi: 10.1007/s42979-022-01023-1.

[13] A. Karacı, “VGGCOV19-NET: automatic detection of COVID-19 cases from X-ray images using modified VGG19 CNN architecture and YOLO algorithm,” Neural Comput. Appl., vol. 34, no. 10, pp. 8253–8274, May 2022, doi: 10.1007/s00521-022-06918-x.

[14] M. Sozzi, S. Cantalamessa, A. Cogato, A. Kayad, and F. Marinello, “Automatic Bunch Detection in White Grape Varieties Using YOLOv3, YOLOv4, and YOLOv5 Deep Learning Algorithms,” Agronomy, vol. 12, no. 2, p. 319, Jan. 2022, doi: 10.3390/agronomy12020319.

[15] J. R. da Silva et al., “Recognition of Human Face Regions under Adverse Conditions—Face Masks and Glasses—In Thermographic Sanitary Barriers through Learning Transfer from an Object Detector,” Machines, vol. 10, no. 1, p. 43, Jan. 2022, doi: 10.3390/machines10010043.

[16] I. H. Al Amin and F. H. Arby, “Implementation of YOLO-v5 for a Real Time Social Distancing Detection,” J. Appl. Informatics Comput., vol. 6, no. 1, pp. 01–06, Jul. 2022, doi: 10.30871/jaic.v6i1.3484.

[17] J.-H. Kim, N. Kim, Y. W. Park, and C. S. Won, “Object Detection and Classification Based on YOLO-V5 with Improved Maritime Dataset,” J. Mar. Sci. Eng., vol. 10, no. 3, p. 377, Mar. 2022, doi: 10.3390/jmse10030377.

[18] S. Degadwala, D. Vyas, U. Chakraborty, A. R. Dider, and H. Biswas, “Yolo-v4 Deep Learning Model for Medical Face Mask Detection,” in 2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS), Mar. 2021, pp. 209–213, doi: 10.1109/ICAIS50930.2021.9395857.

[19] K. V. Sathyamurthy, A. R. Shri Rajmohan, A. Ram Tejaswar, K. V, and G. Manimala, “Realtime Face Mask Detection Using TINY-YOLO V4,” in 2021 4th International Conference on Computing and Communications Technologies (ICCCT), Dec. 2021, pp. 169–174, doi: 10.1109/ICCCT53315.2021.9711838.

[20] W. Jian and L. Lang, “Face mask detection based on Transfer learning and PP-YOLO,” in 2021 IEEE 2nd International Conference on Big Data, Artificial Intelligence and Internet of Things Engineering (ICBAIE), Mar. 2021, pp. 106–109, doi: 10.1109/ICBAIE52039.2021.9389953.

[21] S. Susanto, F. A. Putra, R. Analia, and I. K. L. N. Suciningtyas, “The Face Mask Detection For Preventing the Spread of COVID-19 at Politeknik Negeri Batam,” in 2020 3rd International Conference on Applied Engineering (ICAE), Oct. 2020, pp. 1–5, doi: 10.1109/ICAE50557.2020.9350556.

[22] M. R. Bhuiyan, S. A. Khushbu, and M. S. Islam, “A Deep Learning Based Assistive System to Classify COVID-19 Face Mask for Human Safety with YOLOv3,” in 2020 11th International Conference on Computing, Communication and Networking Technologies (ICCCNT), Jul. 2020, pp. 1–5, doi: 10.1109/ICCCNT49239.2020.9225384.

[23] R. Liu and Z. Ren, “Application of Yolo on Mask Detection Task,” 2021 IEEE 13th Int. Conf. Comput. Res. Dev. ICCRD 2021, pp. 130–136, Jan. 2021, doi: 10.1109/ICCRD51685.2021.9386366.

[24] Y. Li, J. Yan, and B. Hu, “Mask Detection Based On Efficient-YOLO,” in 2021 40th Chinese Control Conference (CCC), Jul. 2021, vol. 2021-July, pp. 4056–4061, doi: 10.23919/CCC52363.2021.9549903.

[25] S. Singh, U. Ahuja, M. Kumar, K. Kumar, and M. Sachdeva, “Face mask detection using YOLOv3 and faster R-CNN models: COVID-19 environment,” Multimed. Tools Appl., vol. 80, no. 13, pp. 19753–19768, May 2021, doi: 10.1007/s11042-021-10711-8.

[26] M. Loey, G. Manogaran, M. H. N. Taha, and N. E. M. Khalifa, “Fighting against COVID-19: A novel deep learning model based on YOLO-v2 with ResNet-50 for medical face mask detection,” Sustain. Cities Soc., vol. 65, p. 102600, Feb. 2021, doi: 10.1016/j.scs.2020.102600.

[27] A. Kumar, A. Kalia, A. Sharma, and M. Kaushal, “A hybrid tiny YOLO v4-SPP module based improved face mask detection vision system,” J. Ambient Intell. Humaniz. Comput., vol. 14, no. 6, pp. 6783–6796, Jun. 2023, doi: 10.1007/s12652-021-03541-x.

[28] J. Yu and W. Zhang, “Face Mask Wearing Detection Algorithm Based on Improved YOLO-v4,” Sensors, vol. 21, no. 9, p. 3263, May 2021, doi: 10.3390/s21093263.

[29] S. Balaji, B. Balamurugan, T. A. Kumar, R. Rajmohan, and P. P. Kumar, “A Brief Survey on AI Based Face Mask Detection System for Public Places,” Irish Interdisciplinary Journal of Science & Research (IIJSR) 2021, p. 10, 2021. [Online]. Available at: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3814341.

[30] D. Danu Prasetia, A. Yuswanto, and B. Wibowo, “Design Of Machine Learning Detection Mask Using Yolo And Darknet On Nvidia Jetson Nano,” TEKNOKOM, vol. 5, no. 1, pp. 88–95, Mar. 2022, doi: 10.31943/teknokom.v5i1.69.

[31] Z. Qin, Z. Guo, and Y. Lin, “An Implementation of Face Mask Detection System Based on YOLOv4 Architecture,” in 2022 14th International Conference on Computer Research and Development (ICCRD), Jan. 2022, pp. 207–213, doi: 10.1109/ICCRD54409.2022.9730470.

[32] J. Ha, M. Kambe, and J. Pe, “Data Mining,” Elsevier, p. 703, 2012, doi: 10.1016/C2009-0-61819-5.

[33] M. J. Zaki and W. Meira, Jr, “Data Mining and Analysis,”. Cambridge University Press, 2014, doi: 10.1017/CBO9780511810114.

[34] M. I. Masum, M. A. Jishan, K. R. Mahmud, and A. K. Al Azad, “Covid Face-Mask Monitoring Dataset,” Harvard Datavers, Apr. 13, 2022. [Online]. Available at: https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/BKPMHT


Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Md Asifuzzaman Jishan, Ananna Islam Bedushe, Md Ataullah Khan Rifat, Bijan Paul, Khan Raqib Mahmud

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

___________________________________________________________
Science in Information Technology Letters
ISSN 2722-4139
Published by Association for Scientific Computing Electrical and Engineering (ASCEE)
W : http://pubs2.ascee.org/index.php/sitech
E : sitech@ascee.org, andri@ascee.org, andri.pranolo.id@ieee.org

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0

View My Stats