Transforming traffic surveillance: a YOLO-based approach to detecting helmetless riders through CCTV

(1) * Fuad Izzudin Ariwibowo Mail (Informatics Department, Universitas Ahmad Dahlan, Indonesia)
(2) Dewi Pramudi Ismi Mail (Informatics Department, Universitas Ahmad Dahlan, Indonesia)
*corresponding author

Abstract


CCTV systems, while ubiquitous for traffic surveillance in Indonesian roadways, remain underutilized in their potential. The integration of AI and Computer Vision technologies can transform CCTV into a valuable tool for law enforcement, specifically in monitoring and addressing helmet non-compliance among motorcycle riders. This study aims to develop an intelligent system for the accurate detection of helmetless motorcyclists using image analysis. The approach relies on deep learning, involving the creation of a dataset with 764 training images and 102 testing images. A deep convolutional neural network with 23 layers is configured, trained with a batch size of 10 over ten epochs, and employs the YOLO method to identify objects in images and subsequently detect helmetless riders. Accuracy assessment is carried out using the mean Average Precision (mAP) method, resulting in a notable 82.81% detection accuracy for riders without helmets and 75.78% for helmeted riders. The overall mAP score is 79.29%, emphasizing the system's potential to substantially improve road safety and law enforcement efforts

Keywords


Helmet non-compliance; Convolutional neural network; Traffic safety; Real-time object detection; Ai-enhanced surveillance

   

DOI

https://doi.org/10.31763/sitech.v3i1.1216
      

Article metrics

10.31763/sitech.v3i1.1216 Abstract views : 444 | PDF views : 140

   

Cite

   

Full Text

Download

References


[1] R. Peters, “Motorbike-taxi-drivers as Infrastructure in the Indonesian City,” Ethnos, vol. 85, no. 3, pp. 471–490, May 2020, doi: 10.1080/00141844.2018.1541917.

[2] B. P. Statistik, “Development of the Number of Motorized Vehicles by Type (Unit), 2019-2021,” Transportation, 2021. [Online]. Available at: https://www.bps.go.id/indicator/17/57/1/perkembangan-jumlah-kendaraan-bermotor-menurut-jenis.html.

[3] E. J. S. Djula and R. Yusuf, “Vehicle Detection with YOLOv7 on Study Case Public Transportation and General Classification, Prediction of Road Loads,” in 2022 2nd International Seminar on Machine Learning, Optimization, and Data Science (ISMODE), Dec. 2022, pp. 7–11, doi: 10.1109/ISMODE56940.2022.10180924.

[4] M. Shaygan, C. Meese, W. Li, X. (George) Zhao, and M. Nejad, “Traffic prediction using artificial intelligence: Review of recent advances and emerging opportunities,” Transp. Res. Part C Emerg. Technol., vol. 145, p. 103921, Dec. 2022, doi: 10.1016/j.trc.2022.103921.

[5] T. Storme, C. Casier, H. Azadi, and F. Witlox, “Impact Assessments of New Mobility Services: A Critical Review,” Sustainability, vol. 13, no. 6, p. 3074, Mar. 2021, doi: 10.3390/su13063074.

[6] M. F. N. Maghfiroh, A. H. Pandyaswargo, and H. Onoda, “Current Readiness Status of Electric Vehicles in Indonesia: Multistakeholder Perceptions,” Sustainability, vol. 13, no. 23, p. 13177, Nov. 2021, doi: 10.3390/su132313177.

[7] I. Veza et al., “Electric Vehicles in Malaysia and Indonesia: Opportunities and Challenges,” Energies, vol. 15, no. 7, p. 2564, Apr. 2022, doi: 10.3390/en15072564.

[8] M. J. Molina and L. T. Molina, “Megacities and Atmospheric Pollution,” J. Air Waste Manage. Assoc., vol. 54, no. 6, pp. 644–680, Jun. 2004, doi: 10.1080/10473289.2004.10470936.

[9] M. T. Yousif, A. F. M. Sadullah, and K. A. A. Kassim, “A review of behavioural issues contribution to motorcycle safety,” IATSS Res., vol. 44, no. 2, pp. 142–154, Jul. 2020, doi: 10.1016/j.iatssr.2019.12.001.

[10] A. Z. Lutfi, “The Phenomenon of Underage Motorbike Riders in Junior High School Students: A Critical Review of Juvenile Delinquency,” J. Indones. Soc. Sci. Humanit., vol. 10, no. 2, pp. 121–134, Dec. 2020, doi: 10.14203/jissh.v10i2.181.

[11] A. A. Mohammed, K. Ambak, A. M. Mosa, and D. Syamsunur, “A Review of the Traffic Accidents and Related Practices Worldwide,” Open Transp. J., vol. 13, no. 1, pp. 65–83, Jun. 2019, doi: 10.2174/1874447801913010065.

[12] J. Damani and P. Vedagiri, “Safety of motorised two wheelers in mixed traffic conditions: Literature review of risk factors,” J. Traffic Transp. Eng. (English Ed., vol. 8, no. 1, pp. 35–56, Feb. 2021, doi: 10.1016/j.jtte.2020.12.003.

[13] C. Lucci, S. Piantini, G. Savino, and M. Pierini, “Motorcycle helmet selection and usage for improved safety: A systematic review on the protective effects of helmet type and fastening,” Traffic Inj. Prev., vol. 22, no. 4, pp. 301–306, May 2021, doi: 10.1080/15389588.2021.1894640.

[14] F. Rezapur-Shahkolai, E. Vesali-Monfared, M. Barati, and L. Tapak, “Prediction of Helmet Use Behavior among Motorcyclists Based on the Theory of Planned Behavior,” J. Res. Health Sci., vol. 22, no. 4, p. e00564, Dec. 2022, doi: 10.34172/jrhs.2022.99.

[15] S. Nikmatin, B. Hermawan, I. Irmansyah, M. Indro, A. Kueh, and A. Syafiuddin, “Evaluation of the Performance of Helmet Prototypes Fabricated from Acrylonitrile Butadiene Styrene Composites Filled with Natural Resource,” Materials (Basel)., vol. 12, no. 1, p. 34, Dec. 2018, doi: 10.3390/ma12010034.

[16] B. Efendi, L. T. Riski, and A. Wahyurudhanto, “The Role Of Police In Traffic Law Enforcement In Indonesia,” Webology, vol. 18, no. 6, pp. 1003–1012, 2021. [Online]. Available at: https://www.webology.org/data-cms/articles/20220224052528.

[17] J. I. Castillo-Manzano, M. Castro-Nuño, L. López-Valpuesta, and D. J. Pedregal, “From legislation to compliance: The power of traffic law enforcement for the case study of Spain,” Transp. Policy, vol. 75, pp. 1–9, Mar. 2019, doi: 10.1016/j.tranpol.2018.12.009.

[18] M. Ryan, “The Future of Transportation: Ethical, Legal, Social and Economic Impacts of Self-driving Vehicles in the Year 2025,” Sci. Eng. Ethics, vol. 26, no. 3, pp. 1185–1208, Jun. 2020, doi: 10.1007/s11948-019-00130-2.

[19] E. A. Akartuna, S. D. Johnson, and A. Thornton, “Preventing the money laundering and terrorist financing risks of emerging technologies: An international policy Delphi study,” Technol. Forecast. Soc. Change, vol. 179, p. 121632, Jun. 2022, doi: 10.1016/j.techfore.2022.121632.

[20] M. Sajjad, M. Nasir, F. U. M. Ullah, K. Muhammad, A. K. Sangaiah, and S. W. Baik, “Raspberry Pi assisted facial expression recognition framework for smart security in law-enforcement services,” Inf. Sci. (Ny)., vol. 479, pp. 416–431, Apr. 2019, doi: 10.1016/j.ins.2018.07.027.

[21] A. Agrahari and D. Singh, “Smart City Transportation Technologies: Automatic No-Helmet Penalizing System,” in In: Singh, D., Rajput, N. (eds) Blockchain Technology for Smart Cities. Blockchain Technologies. Springer, 2020, pp. 115–132, doi: 10.1007/978-981-15-2205-5_6.

[22] V. Gururaj, S. V. Ramesh, S. Satheesh, A. Kodipalli, and K. Thimmaraju, “Analysis of deep learning frameworks for object detection in motion,” Int. J. Knowledge-based Intell. Eng. Syst., vol. 26, no. 1, pp. 7–16, Jun. 2022, doi: 10.3233/KES-220002.

[23] A. Gupta, A. Anpalagan, L. Guan, and A. S. Khwaja, “Deep learning for object detection and scene perception in self-driving cars: Survey, challenges, and open issues,” Array, vol. 10, p. 100057, Jul. 2021, doi: 10.1016/j.array.2021.100057.

[24] J. Jain, R. Parekh, J. Parekh, S. Shah, and P. Kanani, “Helmet Detection and License Plate Extraction Using Machine Learning and Computer Vision,” Guru, D.S., Y. H., S.K., K., B., Agrawal, R.K., Ichino, M. Cogn. Recognition. ICCR 2021. Commun. Comput. Inf. Sci., vol. 1697, pp. 258–268, 2022, doi: 10.1007/978-3-031-22405-8_20.

[25] V. Patel, A. Chesmore, C. M. Legner, and S. Pandey, “Trends in Workplace Wearable Technologies and Connected‐Worker Solutions for Next‐Generation Occupational Safety, Health, and Productivity,” Adv. Intell. Syst., vol. 4, no. 1, p. 30, Jan. 2022, doi: 10.1002/aisy.202100099.

[26] J. Barnett et al., “Automated Vehicles Sharing the Road: Surveying Detection and Localization of Pedalcyclists,” IEEE Trans. Intell. Veh., vol. 6, no. 4, pp. 649–664, Dec. 2021, doi: 10.1109/TIV.2020.3046859.

[27] R. B. D. R, A. Rathee, K. Kalita, and M. S. Deo, “Helmet detection on two-wheeler riders using machine learning,” Int. J. Adv. Electron. Comput. Sci., vol. 5, no. 9, pp. 14–17, 2018. [Online]. Available at: https://www.iraj.in/journal/journal_file/journal_pdf/12-499-154338288914-17.pdf.

[28] J. Li et al., “Safety helmet wearing detection based on image processing and machine learning,” in 2017 Ninth International Conference on Advanced Computational Intelligence (ICACI), Feb. 2017, pp. 201–205, doi: 10.1109/ICACI.2017.7974509.

[29] S. Sanjana, S. Sanjana, V. R. Shriya, G. Vaishnavi, and K. Ashwini, “A review on various methodologies used for vehicle classification, helmet detection and number plate recognition,” Evol. Intell., vol. 14, no. 2, pp. 979–987, Jun. 2021, doi: 10.1007/s12065-020-00493-7.

[30] M. Swapna, T. Wajeeh, and S. Jabeen, “A Hybrid Approach for Helmet Detection for Riders Safety using Image Processing, Machine Learning, Artificial Intelligence,” Int. J. Comput. Appl., vol. 182, no. 37, pp. 50–55, Jan. 2019, doi: 10.5120/ijca2019918397.

[31] A. H. Pratomo, M. Y. Florestyanto, Y. I. Sania, B. Ihsan, H. H. Triharminto, and L. Hernandez, “Image processing for student emotion monitoring based on fisherface method,” Sci. Inf. Technol. Lett., vol. 2, no. 1, pp. 43–53, May 2021, doi: 10.31763/sitech.v2i1.690.

[32] A. H. Pratomo, W. Kaswidjanti, A. S. Nugroho, and S. Saifullah, “Parking detection system using background subtraction and HSV color segmentation,” Bull. Electr. Eng. Informatics, vol. 10, no. 6, pp. 3211–3219, Dec. 2021, doi: 10.11591/eei.v10i6.3251.

[33] A. B. Wahyutama and M. Hwang, “YOLO-Based Object Detection for Separate Collection of Recyclables and Capacity Monitoring of Trash Bins,” Electronics, vol. 11, no. 9, p. 1323, Apr. 2022, doi: 10.3390/electronics11091323.

[34] X. Huang, C. Lin, L. Ji, and G. Feng, “Species inventories from different data sources ‘shaping’ slightly different avifauna diversity patterns,” Front. Ecol. Evol., vol. 11, p. 12, Mar. 2023, doi: 10.3389/fevo.2023.1121422.

[35] L. Huang, Q. Fu, M. He, D. Jiang, and Z. Hao, “Detection algorithm of safety helmet wearing based on deep learning,” Concurr. Comput. Pract. Exp., vol. 33, no. 13, p. 14, Jul. 2021, doi: 10.1002/cpe.6234.

[36] M. Tabary et al., “The effectiveness of different types of motorcycle helmets – A scoping review,” Accid. Anal. Prev., vol. 154, p. 106065, May 2021, doi: 10.1016/j.aap.2021.106065.

[37] B. Zhang, C.-F. Sun, S.-Q. Fang, Y.-H. Zhao, and S. Su, “Workshop Safety Helmet Wearing Detection Model Based on SCM-YOLO,” Sensors, vol. 22, no. 17, p. 6702, Sep. 2022, doi: 10.3390/s22176702.

[38] F. W. Siebert and H. Lin, “Detecting motorcycle helmet use with deep learning,” Accid. Anal. Prev., vol. 134, p. 105319, Jan. 2020, doi: 10.1016/j.aap.2019.105319.

[39] H. Lin, J. D. Deng, D. Albers, and F. W. Siebert, “Helmet Use Detection of Tracked Motorcycles Using CNN-Based Multi-Task Learning,” IEEE Access, vol. 8, pp. 162073–162084, 2020, doi: 10.1109/ACCESS.2020.3021357.

[40] S. Srivastava, A. V. Divekar, C. Anilkumar, I. Naik, V. Kulkarni, and V. Pattabiraman, “Comparative analysis of deep learning image detection algorithms,” J. Big Data, vol. 8, no. 1, p. 66, Dec. 2021, doi: 10.1186/s40537-021-00434-w.

[41] M. L. Francies, M. M. Ata, and M. A. Mohamed, “A robust multiclass 3D object recognition based on modern YOLO deep learning algorithms,” Concurr. Comput. Pract. Exp., vol. 34, no. 1, p. 24, Jan. 2022, doi: 10.1002/cpe.6517.

[42] A. Chairat, M. Dailey, S. Limsoonthrakul, M. Ekpanyapong, and D. R. KC, “Low Cost, High Performance Automatic Motorcycle Helmet Violation Detection,” pp. 3549-3557 Mar. 2020. [Online]. Available at: 10.1109/WACV45572.2020.9093538.

[43] R. Padilla, S. L. Netto, and E. A. B. da Silva, “A Survey on Performance Metrics for Object-Detection Algorithms,” in 2020 International Conference on Systems, Signals and Image Processing (IWSSIP), Jul. 2020, pp. 237–242, doi: 10.1109/IWSSIP48289.2020.9145130


Refbacks

  • There are currently no refbacks.


Copyright (c) 2022 Fuad Izzudin Ariwibowo, Dewi Pramudi Ismi

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

___________________________________________________________
Science in Information Technology Letters
ISSN 2722-4139
Published by Association for Scientific Computing Electrical and Engineering (ASCEE)
W : http://pubs2.ascee.org/index.php/sitech
E : sitech@ascee.org, andri@ascee.org, andri.pranolo.id@ieee.org

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0

View My Stats