A BINARY CLASSIFIER BASED ON FIREFLY ALGORITHM


(Received: 2017-07-27, Revised: 2017-09-27 , Accepted: 2017-10-11)
This work implements the Firefly algorithm (FA) to find the best decision hyper-plane in the feature space. The proposed classifier uses a cross-validation of a 10-fold portioning for the training and the testing phases used for classification. Five pattern recognition binary benchmark problems with different feature vector dimensions are used to demonstrate the effectiveness of the proposed classifier. We compare the FA classifier results with those of other approaches through two experiments. The experimental results indicated that FA classifier is a competitive classification technique. The FA shows better results in three out of the four tested datasets used in the second experiment.

[1] C. Aggarwal and C. Zhai, "A Survey of Text Classification Algorithms in Mining Text Data," Springer, pp. 163-222, 2012.

[2] W. Clancey, "Heuristic Classification," Artificial Intell. Journal, vol. 27, no. 3, pp. 289-350, 1985.

[3] J. Quinlan, "Induction of Decision Trees," Machine Learning, vol. 1, no. 1, pp. 81-106, 1986.

[4] G. Pappa and A. Freitas, Automating the Design of Data Mining Algorithms, Springer Verlag, Berlin Heidelberg, 2010.

[5] M. Mavroforakis and S. Theodoridis, "A Geometric Approach to Support Vector Machine (SVM) Classification," IEEE Transactions on Neural Networks, vol. 17, no. 3, pp. 671-682, 2006.

[6] A. Ng and M. Jordan, "On Discriminative vs. Generative Classifiers: A Comparison of Logistic Regression and Naive Bayes," Advances in Neural Information Processing Systems, vol. 2, pp. 841-848, 2002. 

[7] P. Langley and K. Thompson, "An Analysis of Bayesian Classifiers, " Aaai, 1992.

[8] Jr . Fister, X. Yang, I. Fister, J. Brest and D. Fister, "A Brief Review of Nature-inspired Algorithms for Optimization," arXiv preprint arXiv:1307.4186 , 2013.

[9] X. Yang, "Firefly Algorithms for Multimodal Optimization," International Symposium on Stochastic Algorithms, Stochastic Algorithms: Foundations and Applications (SAGA 2009), Springer, pp. 169-178, 2009.

[10] I. Fister, X. Yang and J. Brest, "A Comprehensive Review of Firefly Algorithms," Swarm and Evolutionary Computation, vol. 13, pp. 34-46, 2013.

[11] X. Yang, "Firefly Algorithm, Stochastic Test Functions and Design Optimization," International Journal of Bio-Inspired Computation,vol. 2, no. 2, pp. 78-84, 2010.

[12] T. Sousa, A. Silva and A. Neves, "Particle Swarm-based Data Mining Algorithms for Classification Task," Parallel Computing, vol. 30, no. 5, pp. 767-783, 2004.

[13] C. Mantas and J. Abellán, "Credal-C4. 5: Decision Tree Based on Imprecise Probabilities to Classify Noisy Data," Expert Systems with Applications, vol. 41, no. 10, pp. 4625-4637, 2014.

[14] N. Bhargava, G. Sharma, R. Bhargava and M. Mathuria,"Decision Tree Analysis on j48 Algorithm for Data Mining," Proceedings of International Journal of Advanced Research in Computer Science and Software Engineering, vol. 3, no. 6, pp. 1114-1119, 2013.

[15] F. Partovi and M. Anandarajan, "Classifying Inventory Using an Artificial Neural Network Approach," Computers & Industrial Engineering, vol. 41, no. 4, pp. 389-404, 2002.

[16] S. Zahiri and S. Seyedin, "Intelligent Particle Swarm Classifiers," Iranian Journal of Electrical and Computer Engineering, vol. 4, no. 1, pp. 63-70, 2005.

[17] D. Martens, M. De Backer, R. Haesen, J. Vanthienen, M. Snoeck and B. Baesens, "Classification with Ant Colony Optimization," IEEE Transactions on Evolutionary Computation, vol. 11, no. 5, pp. 651-665, 2007.

[18] Z. Assarzadeh, S. Monadjemi, P. Moallem and S. Hashemi, "Harmony Search-based Classifier," Int. J. Acad. Res. Appl. Sci., vol. 5, no. 1, pp. 108-119, 2015. 

[19] A. Gandomi, X. Yang and A. Alavi, "Mixed Variable Structural Optimization Using Firefly Algorithm," Computers & Structures, vol. 89, no. 23, pp. 2325-2336, 2011.

[20] K. Durkota, Implementation of a Discrete Firefly Algorithm for the QAP Problem within the Seage Framework, BSc Tthesis, Faculty of Electrical Engineering, Czech Technical University, 2011.

[21] M. Sayadi, R. Ramezanian and N. Ghaffari-Nasab, "A Discrete Firefly Meta-heuristic with Local Search for Makespan Minimization in Permutation Flow Shop Scheduling Problems," International Journal of Industrial Engineering Computations, vol. 1, no. 1, pp. 1-10, 2010.

[22] R. Sawalha and I. Abu Doush, "Face Recognition Using Harmony Search-based Selected Features," International Journal of Hybrid Information Technology, vol. 5, no. 2, pp. 1-16, 2012.

[23] G. Jati, "Evolutionary Discrete Firefly Algorithm for Travelling Salesman Problem," Springer, pp. 393-403, 2011.

[24] M. Alweshah, "Firefly Algorithm with Artificial Neural Network for Time Series Problems," Research Journal of Applied Sciences, Engineering and Technology, vol. 7, no. 19, pp. 3978-3982, 2014.

[25] M. Alweshah and S. Abdullah, "Hybridizing Firefly Algorithms with a Probabilistic Neural Network for Solving Classification Problems," Applied Soft Computing, vol. 35, pp. 513-524, 2015.

[26] M. Alweshah, A. Hammouri and S. Tedmori, "Biogeography-based Optimization for Data Classification Problems," International Journal of Data Mining, Modelling and Management, vol. 9, no. 2, pp.142-162, 2017.

[27] H. Faris, I. Aljarah, N. Al-Madi and S. Mirjalili, "Optimizing the Learning Process of Feed Forward Neural Networks Using Lightning Search Algorithm," International Journal on Artificial Intelligence Tools, vol. 25, no. 6, 2016.

[28] I. Aljarah, H. Faris and S. Mirjalili, "Optimizing Connection Weights in Neural Networks Using the Whale Optimization Algorithm," Soft Computing, pp.1-15, 2016.

[29] P. Cheewaprakobkit, "Study of Factors Analysis Affecting Academic Achievement of Undergraduate Students in International Program," Proceedings of the International Multi-conference of Engineers and Computer Scientists, 2013.

[30] N. Diamantidis, D. Karlis and E. Giakoumakis, "Unsupervised Stratification of Cross-validation for Accuracy Estimation," Artificial Intelligence Journal, vol. 116, no. 2, pp. 1-16, 2000.

[31] O. Inan, M. Uzer and N. Yılmaz, "A New Hybrid Feature Selection Method Based on Association Rules and PCA for Detection of Breast Cancer," International Journal of Innovative Computing, Information and Control, vol. 9, no. 2, pp. 727-729, 2013.

[32] S. ElMustafa, A. Jaradat, I. Abu Doush and N. Mansour, "Community Detection Using Intelligent Water Drops Optimization Algorithm," International Journal of Reasoning-based Intelligent Systems, vol. 9, no. 1, pp. 52-65, 2017.