RECOGNITION OF ARABIC HANDWRITTEN CHARACTERS USING RESIDUAL NEURAL NETWORKS


(Received: 8-Mar.-2021, Revised: 8-May-2021 , Accepted: 22-May-2021)
This study proposes the use of Residual Neural Networks (ResNets) to recognize Arabic offline isolated handwritten characters including Arabic digits. ResNets is a deep learning approach which showed effectiveness in many applications more than conventional machine learning approaches. The proposed approach consists of three main phases: pre-processing phase, training the ResNet on the training set and testing the trained ResNet on the datasets. The evaluation of the proposed approach is performed on three available datasets: MADBase, AIA9K and AHCD. The proposed approach achieved accuracies of 99.8%, 99.05% and 99.55% on these datasets, respectively. It also achieved a validation accuracy of 98.9% on the constructed dataset based on the three datasets.

[1] C. Boufenar and M. Batouche, "Investigation on Deep Learning for Off-line Handwritten Arabic Character Recognition Using Theano Research Platform," Intelligent Systems and Computer Vision (ISCV), pp. 1-6, DOI: 10.1109/ISACV.2017.8054902, Fez, Morocco, 2017.

[2] Y. Lecun, L. Bottou, Y. Bengio and P. Haffner, "Gradient-based Learning Applied to Document Recognition," Proc. of the IEEE, vol. 86, no. 11, pp. 2278-2324, DOI: 10.1109/5.726791, 1998.

[3] A. Krizhevsky, I. Sutskever and G. E. Hinton, "ImageNet Classification with Deep Convolutional Neural networks," Communications of the ACM, vol. 60, no. 6, pp. 84–90, DOI: 10.1145/3065386, 2017.

[4] S. Wu, S. Zhong and Y. Liu, "Deep Residual Learning for Image Steganalysis," Multimedia Tools and Applications, vol. 77, pp. 10437-10453, 2018.

[5] A. Shiquzzaman and A. K. Tushar, "Handwritten Arabic Numeral Recognition Using Deep Learning Neural Networks," Proc. of the IEEE International Conference on Imaging, Vision & Pattern Recognition (icIVPR), pp. 1-4, DOI: 10.1109/ICIVPR.2017.7890866, Dhaka, Bangladesh, 2017.

[6] M. Mudhsh and R. Almodfer, "Arabic Handwritten Alphanumeric Character Recognition Using Very Deep Neural Network," Information, vol. 8, no. 3, pp. 105-118, DOI: 10.3390/info8030105, 2017.

[7] K. Younis and A. N. Alkhateeb, "A New Implementation of Deep Neural Networks for Optical Character Recognition and Face Recognition," Proc. of the International Conference on New Trends in Information Technology (NTIT-2017), pp. 1-6, Amman, Jordan, April 2017.

[8] H. Tomimori, K. T. Chen and T. Baba, "A Convolutional Neural Network with Incremental Learning," Journal of Signal Processing, vol. 21, no. 4, pp. 155-158, 2017.

[9] A. Eladel, R. Ejbali, M. Zaied and C. Ben Amar, "Fast Deep Neural Network Based on Intelligent Dropout and Layer Skipping," Proc. of the International Joint Conference on Neural Networks, [Online], Available: https://doi.org/10.1109/IJCNN.2017.7965947, 2017.

[10] K. S. Younis, "Arabic Handwritten Character Recognition Based on Deep Convolutional Neural Networks," Jordanian Journal of Computers and Information Technology (JJCIT), vol. 3, no. 3, pp. 186- 200, 2017.

[11] M. Elleuch, R. Maalej and M. Kherallah, "A New Design Based-SVM of the CNN Classifier Architecture with Dropout for Offline Arabic Handwritten Recognition," Procedia Computer Science, vol. 80, pp. 1712-1723, DOI: 10.1016/j.procs.2016.05.512, 2016.

[12] N. Tagougui and M. Kherallah, "Recognizing Online Arabic Handwritten Characters Using a Deep Architecture," Proc. of the 9th International Conference on Machine Vision (ICMV 2016), vol. 10341, DOI: 10.1117/12.2268419, Nice, France, 2017.

[13] S. Karthik and K. Srikanta Murthy, "Deep Belief Network Based Approach to Recognize Handwritten Kannada Characters Using Histogram of Oriented Gradients and Raw Pixel Features," International Journal of Applied Engineering Research, vol. 11, no. 5, pp. 3553-3557, 2016.

[14] M. E. Mustafa and M. K. Elbashir, "A Deep Learning Approach for Handwritten Arabic Names Recognition," International Journal of Advanced Computer Science and Applications, vol. 11, no. 1, pp. 678-682, DOI: 10.14569/IJACSA.2020.0110183, 2020.

 

[15] T. M. Ghanim, M. I. Khalil and H. M. Abbas, "Comparative Study on Deep Convolution Neural Networks DCNN-based Offline Arabic Handwriting Recognition," IEEE Access, vol. 8, pp. 95465-95482, 2020.

[16] N. Altwaijry and Isra Al-Turaiki, "Arabic Handwriting Recognition System Using Convolutional Neural Network," Neural Computing and Applications, vol. 33, pp. 2249-2261, 2021.

[17] H. Akouaydi, S. Njah, W. Ouarda, A. Samet, M. Zaied and A. M. Alimi, "Convolutional Neural Networks for Online Arabic Characters Recognition with Beta-elliptic Knowledge Domain," Proc. of the IEEE International Conference on Document Analysis and Recognition Workshops (ICDARW), pp. 41-46, DOI: 10.1109/ICDARW.2019.50114, Sydney, Australia, 2019.

[18] K. He, X. Zhang, S. Ren and J. Sun, "Identity Mappings in Deep Residual Networks," Proc. of the European Conference on Computer Vision (ECCV 2016), Part of the Lecture Notes in Computer Science, vol. 9908, DOI: 10.1007/978-3-319-46493-0_38, Springer, Cham, 2016.

[19] P. Sermanet, S. Chintala and Y. LeCun, "Convolutional Neural Networks Applied to House Numbers Digit Classification," Proc. of the 21st International Conference on Pattern Recognition (ICPR2012), pp. 3288-3291, Tsukuba, Japan, 2012.

[20] M. Längkvist, L. Karlsson and A. Loutfi, "A Review of Unsupervised Feature Learning and Deep Learning for Time-series Modeling," Pattern Recognition Letters, vol. 42, pp. 11-24, 2014.

[21] K. He, X. Zhang, S. Ren and J. Sun, "Deep Residual Learning for Image Recognition," Proc. of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 770-778, DOI: 10.1109/ICDARW.2019.50114, Las Vegas, USA, 2016.

[22] S. Ioffe and C. Szegedy, "Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift," Proc. of the 32nd International Conference on International Conference on Machine Learning (CML'15), vol. 37, pp. 448–456, 2015.

[23] B. Xu, N. Wang, T. Chen and M. Li, "Empirical Evaluation of Rectified Activations in Convolutional Network," Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML), [Online], available: http://arxiv.org/abs/1505.00853, 2015.

[24] A. L. Maas, A. Y. Hannun and A. Y. Ng, "Rectifier Nonlinearities Improve Neural Network Acoustic Models, " Proc. of the 30th International Conference on Machine Learning, JMLR: W&CP, vol. 28, Atlanta, Georgia, USA, 2013.

[25] A. El-Sawy, M. Loey and E. B. Hazem, "Arabic Handwritten Characters Recognition Using Convolutional Neural Network, " WSEAS Transactions on Computer Research, vol. 5, pp.11-19, 2017.

[26] A. El-Sawy, H. EL-Bakry and M. Loey, "CNN for Handwritten Arabic Digits Recognition Based on LeNet-5," Proc. of the International Conference on Advanced Intelligent Systems and Informatics (AISI 2016), Part of the Advances in Intelligent Systems and Computing, vol. 533, DOI: 10.1007/978-3-319- 48308-5_54, Springer, Cham, 2017.

[27] N. Lamghari and S. Raghay, "DBAHCL: Database for Arabic Handwritten Characters and Ligatures," International Journal of Multimedia Information Retrieval," vol. 6, pp. 263-269, 2017.

[28] C. Boufenar, M. Batouche and M. Schoenauer, "An Artificial Immune System for Offline Isolated Handwritten Arabic Character Recognition," Evolving Systems, vol. 9, pp. 25-41, 2018.

[29] M. Torki, M. E. Hussein, A. Elsallamy, M. Fayyaz and S. Yaser, "Window-based Descriptors for Arabic Handwritten Alphabet Recognition: A Comparative Study on a Novel Dataset," arXiv:1411.3519v2, [Online], Available: https://arxiv.org/pdf/1411.3519.pdf, 2014.

[30] M. Sokolova and G. Lapalme. "A Systematic Analysis of Performance Measures for Classification Tasks," Information Processing and Management, vol. 45, no. 4, pp. 427-437, 2009.

[31] C. Shorten and T. M. Khoshgoftaar, "A Survey on Image Data Augmentation for Deep Learning," Journal of Big Data, vol. 6, no. 60, DOI: 10.1186/s40537-019-0197-0, 2019.

[32] G. Latif, J. Alghazo, L. Alzubaidi, M. M. Naseer and Y. Alghazo, "Deep Convolutional Neural Network for Recognition of Unified Multi-language Handwritten Numerals," Proc. of the 2nd IEEE International Workshop on Arabic and Derived Script Analysis and Recognition (ASAR), pp. 90-95, DOI: 10.1109/ASAR.2018.8480289, London, UK, 2018.