USING RESNET18 IN A DEEP-LEARNING FRAMEWORK AND ASSESSING THE EFFECTS OF ADAPTIVE LEARNING RATES IN THE IDENTIFICATION OF MALIGNANT BREAST MASSES IN MAMMOGRAMS

(Received: 12-Nov.-2023, Revised: 8-Jan.-2024 , Accepted: 25-Jan.-2024)

Authors Soumia Benbakreti, Samir Benbakreti, Kadda Benyahia, Mohamed Benouis,

Keywords #Malignant breast cancer #Lesion classification #Transfer learning #Residual network (ResNet18) #Adaptive learning rate

Abstract Breast cancer is a prevalent disease that primarily affects women globally, but it can also affect men. Early detection is crucial for better treatment outcomes and mammography is a common screening method. Recommendations for mammograms vary by age and country. Early breast-cancer screening is vital for timely interventions. This paper aims to introduce artificial-intelligence methods through deep-learning approaches utilizing pre-trained CNN-based models for the diagnosis of masses depicted in breast images. These masses may be either malignant or benign, necessitating distinct management strategies for each scenario. The experiments conducted on pre-trained models (AlexNet, InceptionV3 and ResNet18) are designed to underscore the significance of selecting the batch size and adaptive learning rate in influencing the results, ultimately facilitating a notable enhancement in classification rates. Pre-trained models applied to a merged dataset comprising three datasets (Inbreast+MIAS+DDSM) yielded an accuracy of 93.7% for InceptionV3 and 88.9% for AlexNet. However, the most favorable outcome was observed with ResNet18, achieving an accuracy of 95% (with precision, recall and F1-score of 94.90%, 94.91% and 94.91%, respectively).

References

[1] F. Bray, J. Ferlay, I. Soerjomataram, R.L. Siegel, L.A. Torre and A. Jemal, "Global Cancer Statistics 2018: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries," CA: A Cancer Journal for Clinicians, vol. 68, no. 6, pp. 394–424, DOI: 10.3322/caac.21492, 2018.

[2] Y. Tan et al., "Tumor-derived Exosomal Components: The Multifaceted Roles and Mechanisms in Breast Cancer Metastasis," Cell Death and Disease, vol. 12, no. 6, DOI: 10.1038/s41419-021-03825-2, 2021.

[3] M. Desai and M. Shah, "An Anatomization on Breast Cancer Detection and Diagnosis Employing Multi-layer Perceptron Neural Network (MLP) and Convolutional Neural Network (CNN)," Clinical eHealth, vol. 4, pp. 1–11, DOI:10.1016/j.ceh.2020.11.002, 2021.

[4] J. Zuluaga-Gomez et al., "A CNN-based Methodology for Breast Cancer Diagnosis Using Thermal Images, Computer Methods in Biomechanics and Biomedical Engineering," Computer Methods in Biomechanics and Biomedical Engineering: Imaging & Visualization, vol. 9, no. 2, pp. 131–145, 2021.

[5] C. Gonçalves, J. Souza and H. Fernandes, "CNN Architecture Optimization Using Bio-inspired Algorithms for Breast Cancer Detection in Infrared Images," Computers in Biology and Medicine, vol. 142, DOI: 10.1016/j.compbiomed.2021.105205, 2022.

[6] D. A. Zebari et al., "Systematic Review of Computing Approaches for Breast Cancer Detection Based Computer Aided Diagnosis Using Mammogram Images," Applied Artificial Intelligence, vol. 35, no. 15, pp. 2157–2203, DOI: 10.1080/08839514.2021.2001177, 2021.

[7] World Health Organisation, "Breast Cancer: Early Diagnosis and Screening," [Online], Available: http://www.who.int/cancer/prevention/diagnosis-screening/breast-cancer/en/, 2018.

[8] W. Al-Dhabyani, M. Gomaa, H. Khaled and A. Fahmy, "Dataset of Breast Ultrasound Images," Data Brief, vol. 28, pp. 104863, DOI: 10.1016/j.dib.2019.104863, 2020.

[9] D. Sheth and M. L. Giger, "Artificial Intelligence in the Interpretation of Breast Cancer on MRI," Journal of Magnetic Resonance Imaging, vol. 51, no. 5, pp. 1310–1324, DOI: 10.1002/jmri.26878, 2020.

[10] T. K. Y. Tay and P. H. Tan, " Liquid Biopsy in Breast Cancer: A Focused Review," The Archives of Pathology & Laboratory Medicine, vol. 145, no. 6, pp. 678–686, 2021.

[11] J. Kotsopoulos et al., "Tamoxifen and the Risk of Breast Cancer in Women with a BRCA1 or BRCA2 Mutation," Breast Cancer Research and Treatment, vol. 201, no. 2, pp. 257–264, DOI: 10.1007/s10549-023-06991-3, 2023.

[12] Z. M. Colbert and P. Ramachandran, "Auto-segmentation of Thoracic Organs in CT Scans of Breast Cancer Patients Using a 3D U-net Cascaded into 2D PatchGANs", Biomedical Physics & Engineering Express, vol. 9, no. 5, DOI:10.1088/2057-1976/ace631, 2023.

[13] G. Hamed et al.," Deep Learning in Breast Cancer Detection and Classification," Proc. of the Int. Conf. on Artificial Intelligence and Computer Vision (AICV2022), pp. 322–333, DOI: 10.1007/978-3-030-44289-7_30, Cairo, Egypt, 2020.

[14] N. S. Ismail and C. Sovuthy, "Breast Cancer Detection Based on Deep Learning Technique," Proc. of 2019 Int. UNIMAS STEM 12th Eng. Conf. (EnCon), pp. 89–92, DOI: 10.1109/EnCon.2019.8861256, Kuching, Malaysia, 2019.

[15] J. Wu and C. Hicks, "Breast Cancer Type Classification Using Machine Learning," Journal of Personalized Medicine, vol. 11, no. 2:61, DOI: 10.3390/jpm11020061, 2021.

[16] S. Khan, N. Islam, Z. Jan, I. U. Din and Joel J. P. C. Rodrigues, "A Novel Deep Learning Based Framework for the Detection and Classification of Breast Cancer Using Transfer Learning," Pattern Recognition Letters, vol. 125, pp. 1–6, DOI: 10.1016/j.patrec.2019.03.022, 2019.

[17] L. Shen, L. R. Margolies, J. H. Rothstein, E. Fluder, R. McBride and W. Sieh, "Deep Learning to Improve Breast Cancer Detection on Screening Mammography," Scientific Reports, vol.9, no. 1, p. 12495, DOI: 10.1038/s41598-019-48995-4, 2019.

[18] Z. Han, B. Wei and Y. Zheng, "Breast Cancer Multi-classification from Histopathological Images with Structured Deep Learning Model," Scientific Reports, vol. 7, no. 1, p. 4172, DOI: 10.1038/s41598-017-04075-z, 2017.

[19] D. H. Hubel and T. N. Wiesel, "Receptive Fields and Functional Architecture of Monkey Striate Cortex," Journal of Physiology, vol. 195, no. 1, pp. 215–243, DOI: 10.1113/jphysiol.1968.sp008455, 1968.

[20] S. Li, L. Wang, J. Li and Y. Yao, "Image Classification Algorithm based on Improved AlexNet," Journal of Physics: Conference Series, vol. 1813, no. 1, p. 012051, 2021.

[21] C. Szegedy et al., "Going Deeper with Convolutions," Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 1–9, DOI: 10.1109/CVPR.2015.7298594, Boston, MA, USA, 2015.

[22] A. Krizhevsky, I. Sutskever and G. E. Hinton, "Imagenet Classification with Deep Convolutional Neural Networks," Proc. of the Advances in Neural Information Processing Systems (NIPS 2012), vol.25, DOI: 10.1145/3065386, Lake Tahoe, Nevada, United States, 2012.

[23] K. He, X. Zhang, S. Ren and J. Sun, "Deep Residual Learning for Image Recognition," Proc. of the IEEE Conf. on Computer Vision and Pattern Recognition (CVPR), pp. 770–778, DOI: 10.1109/CVPR.2016.90, Las Vegas, NV, USA, 2016.

[24] Kaggle, "Breast Mammography Images with Masses," [Online], Available: https://www.kaggle.com/datasets/tommyngx/breastcancermasses, 04/10/2023.

[25] F. Zhuang et al., "A Comprehensive Survey on Transfer Learning," Proc. of the IEEE, vol. 109, no. 1, pp. 43–76, DOI: 10.1109/JPROC.2020.3004555, 2021.

[26] S. Benbakreti, M. Benouis, A. Roumane and S. Benbakreti, "Impact of the Data Augmentation on the Detection of Brain Tumor from MRI Images Based on CNN and Pre-trained Models," Multimedia Tools and Applications, DOI: 10.1007/s11042-023-17092-0, 2023.

[27] E. M. Dogo et al., "A Comparative Analysis of Gradient Descent-based Optimization Algorithms on Convolutional Neural Networks," Proc. of the Int. Conf. on Computational Techniques, Electronics and Mechanical Systems, pp. 92–99, DOI: 10.1109/CTEMS.2018.8769211, Belagavi, India, 2018.

[28] C. F. G. D. Santos and J. P. Papa, "Avoiding Overfitting: A Survey on Regularization Methods for Convolutional Neural Networks," ACM Computing Surveys, vol. 54, no. (10s), pp. 1-25, DOI: 10.1145/3510413, 2022.

[29] K. Shankar, Y. Zhang, Y. Liu, L. Wu and C.H. Chen, "Hyper-parameter Tuning Deep Learning for Diabetic Retinopathy Fundus Image Classification," IEEE Access, vol. 8, pp. 118164–118173, DOI: 10.1109/ACCESS.2020.3005152, 2020.

[30] X. Zhang et al., "Classification of Mammographic Masses by Deep Learning," Proc. of the 2017 56th Annual Conf. of the Society of Instrument and Control Engineers of Japan (SICE), pp. 793–796, DOI: 10.23919/SICE.2017.8105545, Kanazawa, Japan, 2017.

[31] F. F. Ting, Y. J. Tan and K. S. Sim, "Convolutional Neural Network Improvement for Breast Cancer Classification," Expert Systems with Applications, vol. 120, pp. 103–115, 2019.

[32] H. Chougrad, H. Zouaki and O. Alheyane, "Deep Convolutional Neural Networks for Breast Cancer Screening," Computer Methods and Programs in Biomedicine, vol. 157, pp. 19-30, 2018.

[33] R. Karthiga, K. Narasimhan and R. Amirtharajan, "Diagnosis of Breast Cancer for Modern Mammography Using Artificial Intelligence," Mathematics and Computers in Simulation, vol. 202, pp. 316-330, DOI: /10.1016/j.matcom.2022.05.038, 2022.

[34] J. Wang, M.A. Khan, S. Wang and Y. Zhang, "SNSVM: SqueezeNet-Guided SVM for Breast Cancer Diagnosis," Computers, Materials & Continua, vol. 76, no. 2, DOI: 10.32604/cmc.2023.041191, 2023.

[35] S. U. Rehman et al., "BRMI-Net: Deep Learning Features and Flower Pollination-controlled Regula Falsi-based Feature Selection Framework for Breast Cancer Recognition in Mammography Images," Diagnostics, vol. 13, no. 9, p.1618, DOI: 10.3390/diagnostics13091618, 2023.

[36] M. Fatima, M. A. Khan, S. Shaheen, N. A. Almujally and S. H. Wang, "B2C3NetF2: Breast Cancer Classification Using an End-to-end Deep Learning Feature Fusion and Satin Bowerbird Optimization Controlled Newton Raphson Feature Selection," CAAI Transactions on Intelligence Technology, vol.8, no.4, pp. 1374-1390, DOI: 10.1049/cit2.12219, 2023.

[37] D. Shigemizu et al., "Classification and Deep Learning–based Prediction of Alzheimer Disease Sub-types by Using Genomic Data," Translational Psychiatry, vol.13, no. 1, p. 232, DOI: 10.1038/s41398-023-02531-1, 2023.

[38] X. Liu, H. Wang, Z. Li and L. Qin, "Deep Learning in ECG Diagnosis: A Review," Knowledge-based Systems, vol. 227, p.107187, DOI:10.1016/j.knosys.2021.107187, 2021.

[39] S. Al-Fahdawi et al., "Fundus-DeepNet: Multi-label Deep Learning Classification System for Enhanced Detection of Multiple Ocular Diseases through Data Fusion of Fundus Images," Information Fusion, vol. 102, p.102059, DOI:10.1016/j.inffus.2023.102059, 2024.

[40] P. Roy, M. M. O. Chisty and H. A. Fattah, "Alzheimer’s Disease Diagnosis from MRI Images Using ResNet-152 Neural Network Architecture," Proc. of the 5th Int. Conf. on Electrical Information and Communication Technology (EICT), pp. 1-6, DOI:10.1109/EICT54103.2021.9733507, 2021.

[41] R. Patnaik, P. S. Rath, S. Padhy and S. Dash, "Histopathology Colorectal Cancer Image Classification by Using Inception V4 CNN Model," Proc. of the Int. Conf. on Robotics, Control, Automation and Artificial Intelligence, pp. 1003-1014, DOI:10.1007/978-981-99-4634-1-79, 2022.

[42] M. Dehghan Rouzi et al., "Breast Cancer Detection with an Ensemble of Deep Learning Networks Using a Consensus-adaptive Weighting Method," Journal of Imaging, vol.9, no. 11, p. 247, DOI: 10.3390/jimaging9110247, 2023.

[43] A. B. Bagheri et al., "Potential Applications of Artificial Intelligence (AI) and Machine Learning (ML) on Diagnosis, Treatment, Outcome Prediction to Address Healthcare Disparities of Chronic Limb-threatening Ischemia (CLTI)," Seminars in Vascular Surgery, vol. 36, no. 3, pp. 454-459, 2023.