Evaluation of Stochastic Gradient Descent Optimizer on U-Net Architecture for Brain Tumor Segmentation

(1) * Purwono Purwono Mail (Universitas Harapan Bangsa, Indonesia)
(2) Iis Setiawan Mangkunegara Mail (Universitas Harapan Bangsa, Indonesia)
*corresponding author

Abstract


A brain tumor is a type of disease that is quite dangerous in the world. This disease is one of the main causes of human death and has a high risk of recurrence. There are several types of brain tumor locations such as edema, necrosis to elevation. Segmenting the location of this disease is important to do to support faster recovery efforts. The Convolutional Neural Network (CNN) algorithm, which is part of the deep learning method, can be an alternative to this segmentation effort. The U-Net architecture is part of the CNN algorithm which specifically works on medical image segmentation. This study experimented to build a special U-Net architecture for medical image segmentation that had been optimized with SGD. The data used is BraTS2020O which contains a collection of MRI data. This optimization aims to improve the performance of the U-net architecture for segmenting brain tumor images. The results of the study show that the SGD optimization carried out has succeeded in providing better performance than previous studies. This can be seen from the performance value obtained at 0.9879. This accuracy value indicates an increase in accuracy from previous studies. High accuracy indicates that the SGD-optimized model has good segmentation prediction performance.

Keywords


u-net;sgd;optimizer;segmentation;brain tumor

   

DOI

https://doi.org/10.31763/ijrcs.v3i3.1104
      

Article metrics

10.31763/ijrcs.v3i3.1104 Abstract views : 702 | PDF views : 242

   

Cite

   

Full Text

Download

References


[1] J. Wu et al., “TISS-net: Brain tumor image synthesis and segmentation using cascaded dual-task networks and error-prediction consistency,” Neurocomputing, vol. 544, p. 126295, 2023, https://doi.org/10.1016/j.neucom.2023.126295.

[2] T. Zhou et al., “Prediction of brain tumor recurrence location based on multi-modal fusion and nonlinear correlation learning,” Comput. Med. Imaging Graph., vol. 106, p. 102218, 2023, https://doi.org/10.1016/j.compmedimag.2023.102218.

[3] M. Nazir, S. Shakil, and K. Khurshid, “Role of deep learning in brain tumor detection and classification (2015 to 2020): A review,” Comput. Med. Imaging Graph., vol. 91, p. 101940, 2021, https://doi.org/10.1016/j.compmedimag.2021.101940.

[4] D. N. Louis et al., “The 2021 WHO Classification of Tumors of the Central Nervous System: a summary.,” Neuro. Oncol., vol. 23, no. 8, pp. 1231–1251, Aug. 2021, https://doi.org/10.1093/neuonc/noab106.

[5] S. Lefkovits and L. Lefkovits, “U-Net architecture variants for brain tumor segmentation of histogram corrected images,” Acta Univ. Sapientiae, Inform., vol. 14, no. 1, pp. 49–74, 2022, https://doi.org/10.2478/ausi-2022-0004.

[6] M. Elizabeth and C. Baua, “Quality of Life, Social Support, and Physical Activity of Overweight Adolescents,” J. Adv. Heal. Informatics Res., vol. 1, no. 2, pp. 58–64, 2023, https://doi.org/10.59247/jahir.v1i2.32.

[7] T. Ruba, R. Tamilselvi, and M. Parisa Beham, “Brain tumor segmentation using JGate-AttResUNet – A novel deep learning approach,” Biomed. Signal Process. Control, vol. 84, p. 104926, 2023, https://doi.org/10.1016/j.bspc.2023.104926.

[8] Z. Ullah, M. Usman, M. Jeon, and J. Gwak, “Cascade multiscale residual attention CNNs with adaptive ROI for automatic brain tumor segmentation,” Inf. Sci. (Ny)., vol. 608, pp. 1541–1556, 2022, https://doi.org/10.1016/j.ins.2022.07.044.

[9] Y. Li, Z. Yuan, J. Wang, and Q. Xu, “Laser-induced damage characteristics in fused silica surface due to mechanical and chemical defects during manufacturing processes,” Opt. Laser Technol., vol. 91, pp. 149–158, 2017, https://doi.org/10.1016/j.optlastec.2016.12.022.

[10] T. Zhou, Q. Cheng, H. Lu, Q. Li, X. Zhang, and S. Qiu, “Deep learning methods for medical image fusion: A review,” Comput. Biol. Med., vol. 160, p. 106959, 2023, https://doi.org/10.1016/j.compbiomed.2023.106959.

[11] M. Havaei et al., “Brain tumor segmentation with Deep Neural Networks,” Med. Image Anal., vol. 35, pp. 18–31, 2017, https://doi.org/10.1016/j.media.2016.05.004.

[12] X. Li, G. Luo, and K. Wang, “Multi-step Cascaded Networks for Brain Tumor Segmentation,” in Brainlesion: Glioma, Multiple Sclerosis, Stroke and Traumatic Brain Injuries, 2020, pp. 163–173, https://doi.org/10.1007/978-3-030-46640-4_16.

[13] K. U. Wijaya and E. B. Setiawan, “Hate Speech Detection Using Convolutional Neural Network and Gated Recurrent Unit with FastText Feature Expansion on Twitter,” J. Ilm. Tek. Elektro Komput. dan Inform., vol. 9, no. 3, pp. 619–631, 2023, http://dx.doi.org/10.26555/jiteki.v9i3.26532.

[14] H. Zhang et al., “BCU-Net: Bridging ConvNeXt and U-Net for medical image segmentation,” Comput. Biol. Med., vol. 159, p. 106960, 2023, https://doi.org/10.1016/j.compbiomed.2023.106960.

[15] R. Gamal, H. Barka, and M. Hadhoud, “GAU U-Net for multiple sclerosis segmentation,” Alexandria Eng. J., vol. 73, pp. 625–634, 2023, https://doi.org/10.1016/j.aej.2023.04.069.

[16] J. C. González Sánchez, M. Magnusson, M. Sandborg, Å. Carlsson Tedgren, and A. Malusek, “Segmentation of bones in medical dual-energy computed tomography volumes using the 3D U-Net,” Phys. Medica, vol. 69, pp. 241–247, 2020, https://doi.org/10.1016/j.ejmp.2019.12.014.

[17] Z. Wang, Y. Zou, and P. X. Liu, “Hybrid dilation and attention residual U-Net for medical image segmentation,” Comput. Biol. Med., vol. 134, p. 104449, 2021, https://doi.org/10.1016/j.compbiomed.2021.104449.

[18] J. Walsh, A. Othmani, M. Jain, and S. Dev, “Using U-Net network for efficient brain tumor segmentation in MRI images,” Healthc. Anal., vol. 2, p. 100098, 2022, https://doi.org/10.1016/j.health.2022.100098.

[19] P. Li, W. Wu, L. Liu, F. Michael Serry, J. Wang, and H. Han, “Automatic brain tumor segmentation from Multiparametric MRI based on cascaded 3D U-Net and 3D U-Net++,” Biomed. Signal Process. Control, vol. 78, p. 103979, 2022, https://doi.org/10.1016/j.bspc.2022.103979.

[20] J. Ott, M. Pritchard, N. Best, E. Linstead, M. Curcic, and P. Baldi, "A Fortran-Keras deep learning bridge for scientific computing," Scientific Programming, vol. 2020, pp. 1-13, 2020, https://doi.org/10.1155/2020/8888811.

[21] E. Haghighat and R. Juanes, "SciANN: A Keras/TensorFlow wrapper for scientific computations and physics-informed deep learning using artificial neural networks," Computer Methods in Applied Mechanics and Engineering, vol. 373, p. 113552, https://doi.org/10.1016/j.cma.2020.113552.

[22] Y. Tian, Y. Zhang, and H. Zhang, “Recent Advances in Stochastic Gradient Descent in Deep Learning,” Mathematics, vol. 11, p. 682, 2023, https://doi.org/10.3390/math11030682.

[23] M. Muflih, R. Widaryanti, F. L. Indrawati, and N. G. Trisagita, “Correlation Between Knowledge of Health Information About Picky Eating, Supplementary Feeding, Management Ability of Appetite Herbs,” J. Adv. Heal. Informatics Res., vol. 1, no. 2, pp. 65–74, 2023, https://doi.org/10.59247/jahir.v1i2.34.

[24] S. Sangui, T. Iqbal, P. C. Chandra, S. K. Ghosh, and A. Ghosh, “3D MRI Segmentation using U-Net Architecture for the detection of Brain Tumor,” Procedia Comput. Sci., vol. 218, pp. 542–553, 2023, https://doi.org/10.1016/j.procs.2023.01.036.

[25] D. C. E. Saputra, Y. Maulana, T. A. Win, R. Phann, and W. Caesarendra, “Implementation of Machine Learning and Deep Learning Models Based on Structural MRI for Identification Autism Spectrum Disorder,” J. Ilm. Tek. Elektro Komput. dan Inform., vol. 9, no. 2, pp. 307–318, 2023, http://dx.doi.org/10.26555/jiteki.v9i2.26094.

[26] I. S. Mangkunegara and P. Purwono, “Analysis of DNA Sequence Classification Using SVM Model with Hyperparameter Tuning Grid Search CV,” in 2022 IEEE International Conference on Cybernetics and Computational Intelligence (CyberneticsCom), 2022, pp. 427–432, https://doi.org/10.1109/CyberneticsCom55287.2022.9865624.

[27] R. Nyirandayisabye, H. Li, Q. Dong, T. Hakuzweyezu, and F. Nkinahamira, “Automatic pavement damage predictions using various machine learning algorithms: Evaluation and comparison,” Results Eng., vol. 16, p. 100657, 2022, https://doi.org/10.1016/j.rineng.2022.100657.

[28] D. Arifah, T. H. Saragih, D. Kartini, and M. I. Mazdadi, “Application of SMOTE to Handle Imbalance Class in Deposit Classification Using the Extreme Gradient Boosting Algorithm,” J. Ilm. Tek. Elektro Komput. dan Inform., vol. 9, no. 2, pp. 396–410, 2023, http://dx.doi.org/10.26555/jiteki.v9i2.26155.

[29] M. Ahmad et al., “Industry 4.0 technologies and their applications in fighting COVID-19 pandemic using deep learning techniques,” Comput. Biol. Med., vol. 145, p. 105418, 2022, https://doi.org/10.1016/j.compbiomed.2022.105418.

[30] N. N, “Early identification of Alzheimer’s Disease using medical imaging: A review from a machine learning approach perspective,” J. Ilm. Tek. Elektro Komput. dan Inform., vol. 9, no. 3, 2023, http://dx.doi.org/10.26555/jiteki.v9i3.25148.

[31] D. A. Pramudhita, F. Azzahra, I. K. Arfat, R. Magdalena, and S. Saidah, “Strawberry Plant Diseases Classification Using CNN Based on MobileNetV3-Large and EfficientNet-B0 Architecture,” J. Ilm. Tek. Elektro Komput. dan Inform., vol. 9, no. 3, pp. 522–534, 2023, http://dx.doi.org/10.26555/jiteki.v9i3.26341.

[32] B. D. Satoto, R. T. Wahyuningrum, and B. K. Khotimah, “Classification of Corn Seed Quality Using Convolutional Neural Network with Region Proposal and Data Augmentation,” J. Ilm. Tek. Elektro Komput. dan Inform., vol. 9, no. 2, pp. 348–362, 2023, http://dx.doi.org/10.26555/jiteki.v9i2.26222.

[33] N. Siddique, S. Paheding, C. P. Elkin, and V. Devabhaktuni, “U-net and its variants for medical image segmentation: A review of theory and applications,” IEEE Access, pp. 82031–82057, 2021, https://doi.org/10.1109/ACCESS.2021.3086020.

[34] C. Li, X. Li, and R. Zhou, “Cochlear CT image segmentation based on u-net neural network,” J. Radiat. Res. Appl. Sci., vol. 16, no. 2, p. 100560, 2023, https://doi.org/10.1016/j.jrras.2023.100560.

[35] R. Li et al., “A novel U-Net based data-driven vanadium redox flow battery modelling approach,” Electrochim. Acta, vol. 444, p. 141998, 2023, https://doi.org/10.1016/j.electacta.2023.141998.

[36] H. Bai, J. Mao, and S.-H. Gary Chan, “A survey on deep learning-based single image crowd counting: Network design, loss function and supervisory signal,” Neurocomputing, vol. 508, pp. 1–18, 2022, https://doi.org/10.1016/j.neucom.2022.08.037.

[37] Q. Wang, Y. Ma, K. Zhao, and Y. Tian, "A comprehensive survey of loss functions in machine learning," Annals of Data Science, pp. 1-26, 2020, https://doi.org/10.1007/s40745-020-00253-5.

[38] Y. Feng et al., “A comparative study of automatic image segmentation algorithms for target tracking in MR-IGRT,” J. Appl. Clin. Med. Phys., vol. 17, no. 2, pp. 441–460, 2016, https://doi.org/10.1120/jacmp.v17i2.5820.

[39] M. Alidoost et al., “Model utility of a deep learning-based segmentation is not Dice coefficient dependent: A case study in volumetric brain blood vessel segmentation,” Intell. Med., vol. 7, p. 100092, 2023, https://doi.org/10.1016/j.ibmed.2023.100092.

[40] D. N. Triwibowo, B. P. Dewa, B. B. Sumantri, and R. Suryani, “Identification of Breast Tumors With Image Processing Using Canny Edge Detection,” J. Adv. Heal. Informatics Res., vol. 1, no. 1, pp. 28–34, 2023, https://doi.org/10.59247/jahir.v1i1.20.

[41] K. Y. Halim, D. T. Nugrahadi, M. R. Faisal, and R. Herteno, “Gender Classification Based on Electrocardiogram Signals Using Long Short Term Memory and Bidirectional Long Short Term Memory,” J. Ilm. Tek. Elektro Komput. dan Inform., vol. 9, no. 3, pp. 606–618, 2023, http://dx.doi.org/10.26555/jiteki.v9i3.26354.

[42] M. F. Nafiz, D. Kartini, M. R. Faisal, F. Indriani, and T. Hamonangan, “Automated Detection of COVID-19 Cough Sound using Mel- Spectrogram Images and Convolutional Neural Network,” J. Ilm. Tek. Elektro Komput. dan Inform., vol. 9, no. 3, pp. 535–548, 2023, http://dx.doi.org/10.26555/jiteki.v9i3.26374.

[43] F. Melky, S. Sendari, and I. A. Elbaith, “Optimization of Heavy Point Position Measurement on Vehicles Using Support Vector Machine,” J. Ilm. Tek. Elektro Komput. dan Inform., vol. 9, no. 3, pp. 673–683, 2023, http://dx.doi.org/ 10.26555/jiteki.v9i3.26261.

[44] M. Ilham, A. Prihantoro, I. K. Perdana, R. Magdalena, and S. Saidah, “Experimenting with the Hyperparameter of Six Models for Glaucoma Classification,” J. Ilm. Tek. Elektro Komput. dan Inform., vol. 9, no. 3, pp. 571–584, 2023, http://dx.doi.org/ 10.26555/jiteki.v9i3.26331.

[45] L. Marco, “Comparative Study of Optimizers in the Training of a Convolutional Neural Network in a Binary Recognition Model,” Res. Comput. Sci., vol. 150, no. 4, pp. 73–82, 1870.

[46] Z. Qu, S. Yuan, R. Chi, L. Chang, and L. Zhao, “Genetic Optimization Method of Pantograph and Catenary Comprehensive Monitor Status Prediction Model Based on Adadelta Deep Neural Network,” IEEE Access, vol. 7, pp. 23210–23221, 2019, https://doi.org/10.1109/ACCESS.2019.2899074.

[47] J. Sharma et al., “A novel long term solar photovoltaic power forecasting approach using LSTM with Nadam optimizer: A case study of India,” Energy Sci. Eng., vol. 10, no. 8, pp. 2909–2929, 2022, https://doi.org/10.1002/ese3.1178.

[48] D. Yi, J. Ahn, and S. Ji, “An Effective Optimization Method for Machine Learning Based on ADAM,” Applied Sciences, vol. 10, no. 3. 2020, https://doi.org/10.3390/app10031073.

[49] E. Hassan, M. Y. Shams, N. A. Hikal, and S. Elmougy, “The effect of choosing optimizer algorithms to improve computer vision tasks: a comparative study,” Multimed. Tools Appl., vol. 82, no. 11, pp. 16591–16633, 2023, https://doi.org/10.1007/s11042-022-13820-0.

[50] S. A. H. Hosseini, B. Yaman, S. Moeller, M. Hong, and M. Akçakaya, "Dense Recurrent Neural Networks for Accelerated MRI: History-Cognizant Unrolling of Optimization Algorithms," in IEEE Journal of Selected Topics in Signal Processing, vol. 14, no. 6, pp. 1280-1291, 2020, https://doi.org/10.1109/JSTSP.2020.3003170.

[51] Y. Shen, F. Zhang, D. Liu, W. Pu, and Q. Zhang, “Manhattan-distance IOU loss for fast and accurate bounding box regression and object detection,” Neurocomputing, vol. 500, pp. 99–114, 2022, https://doi.org/10.1016/j.neucom.2022.05.052.

[52] C. Shorten and T. M. Khoshgoftaar, “A survey on Image Data Augmentation for Deep Learning,” J. Big Data, vol. 6, no. 1, p. 60, 2019, https://doi.org/10.1186/s40537-019-0197-0.

[53] M. Yaqub et al., “State-of-the-Art CNN Optimizer for Brain Tumor Segmentation in Magnetic Resonance Images.,” Brain Sci., vol. 10, no. 7, 2020, https://doi.org/10.3390/brainsci10070427.


Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Purwono Purwono

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 


About the JournalJournal PoliciesAuthor Information

International Journal of Robotics and Control Systems
e-ISSN: 2775-2658
Website: https://pubs2.ascee.org/index.php/IJRCS
Email: ijrcs@ascee.org
Organized by: Association for Scientific Computing Electronics and Engineering (ASCEE)Peneliti Teknologi Teknik IndonesiaDepartment of Electrical Engineering, Universitas Ahmad Dahlan and Kuliah Teknik Elektro
Published by: Association for Scientific Computing Electronics and Engineering (ASCEE)
Office: Jalan Janti, Karangjambe 130B, Banguntapan, Bantul, Daerah Istimewa Yogyakarta, Indonesia