ENHANCING COLLABORATIVE FILTERING RECOMMENDATION USING REVIEW TEXT CLUSTERING

(Received: 6-Jan.-2021, Revised: 5-Mar.-2021 , Accepted: 27-Mar.-2021)

Authors Ayman S. Ghabayen, Basem H. Ahmed,

Keywords #Recommender systems #Collaborative filtering #Review text #Clustering #Top-N recommendation

Abstract The enormous rapid growth of the online world and universal computing brought a wide range of choices for Internet users to obtain information of interest. However, the huge amount of new information released every day in "big data" is greater than the human information processing capacity. As a result, it becomes harder and harder for users to obtain the required information quickly and they are also facing the problem of information overload. Collaborative Filtering (CF) systems play an important role in overcoming the information overload phenomenon by providing users with relevant information based on their preferences. CF is one of the best recommendation approaches that automate the process of the “word-of-mouth” paradigm. The most critical tasks in CF are finding similar users with similar preferences and then predicting user ratings to provide a personalized list of ranked items to the users. Previous studies have almost exclusively focused on these tasks separately to enhance the quality of recommendation. Nevertheless, we argue that these two tasks are not completely independent, but are part of an incorporated process. The purpose of this study is to propose a recommendation method that bridge the gap between the tasks of rating prediction and ranking to better grasp the best similar users to the target user by combing the advantage potential information of users review text clustering and user numerical ratings to enhance the CF recommendation methods proposed in the literature. The experimental results on three different datasets from Amazon show a considerable improvement over the baseline CF approaches in terms of recall, precision and F1-measure.

References

[1] X. Su and T. M. Khoshgoftaar, "A Survey of Collaborative Filtering Techniques," Advances in Artificial Intelligence, vol. 2009, Article ID: 421425, DOI: 10.1155/2009/421425, 2009.

[2] J. Bobadilla, F. Ortega, A. Hernando and A. Gutiérrez, "Recommender Systems Survey," Knowledge-based Systems, vol. 46, pp. 109-132, 2013.

[3] I. AlAgha and Yousef Abu-Samra, "Tag Recommendation for Short Arabic Text by Using Latent Semantic Analysis of Wikipedia," Jordanian Journal of Computers and Information Technology (JJCIT), vol. 06, no. 02, pp. 165-181, 2020.

[4] K. Tarnowska, Z. W. Ras and L. Daniel, "Customer Loyalty Improvement," Proc. of Recommender System for Improving Customer Loyalty Book, pp. 7-11, Cham: Springer International Publishing, 2020.

[5] A. S. Ghabayen and S. M. Noah, "Using Tags for Measuring the Semantic Similarity of Users to Enhance Collaborative Filtering Recommender Systems," International Journal on Advanced Science, Engineering and Information Technology, vol. 7, no. 6, pp. 2063-2070, 2017.

[6] J. L. Herlocker, J. A. Konstan and J. Riedl, "Explaining Collaborative Filtering Recommendations," Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work, pp. 241-250, DOI: 10.1145/358916.358995, Philadelphia, Pennsylvania, USA, 2000.

[7] S. Natarajan, S. Vairavasundaram, S. Natarajan and A. H. Gandomi, "Resolving Data Sparsity and Cold Start Problem in Collaborative Filtering Recommender System Using Linked Open Data," Expert Systems with Applications, vol. 149, p. 113248, 2020.

[8] L. Al Qadi, H. El Rifai, S. Obaid and A. Elnagar, "A Scalable Shallow Learning Approach For Tagging Arabic News Articles," Jordanian Journal of Computers and Information Technology (JJCIT), vol. 06, no. 03, pp. 263-280, 2020.

[9] G. Alshammari, J. L. Jorro-Aragoneses, N. Polatidis, S. Kapetanakis, E. Pimenidis and M. Petridis, "A Switching Multi-level Method for the Long Tail Recommendation Problem," Journal of Intelligent & Fuzzy Systems, vol. 37, pp. 7189-7198, 2019.

[10] J.-H. Su, W.-Y. Chang and V. S. Tseng, "Effective Social Content-based Collaborative Filtering for Music Recommendation," Intelligent Data Analysis, vol. 21, no. S1, pp. S195-S216, 2017.

[11] H.-A. Nuria, "A Literature Review of Word of Mouth and Electronic Word of Mouth: Implications for Consumer Behavior," Frontiers in Psychology, Mini Review, vol. 8, p. 1256, DOI: 10.3389/fpsyg.2017.01256, July 2017.

[12] A. Ghosal, A. Nandy, A. K. Das, S. Goswami and M. Panday, "A Short Review on Different Clustering Techniques and Their Applications," Proc. of Emerging Technology in Modelling and Graphics, pp. 69- 83, Part of the Advances in Intelligent Systems and Computing Book Series, vol. 937, Springer, 2020.

[13] T. Nicholls and J. Bright, "Understanding News Story Chains Using Information Retrieval and Network Clustering Techniques," Communication Methods and Measures, vol. 13, no. 1, pp. 43-59, 2019.

[14] M. Allahyari, S. Pouriyeh, M. Assefi, S. Safaei, E. D. Trippe and J. B. Gutierrez, "A Brief Survey of Text Mining: Classification, Clustering and Extraction Techniques," KDD Bigdas, Halifax, Canada, arXiv:1707.02919, 2017.

[15] K. G. Dhal, A. Das, S. Ray and J. Gálvez, "Randomly Attracted Rough Firefly Algorithm for Histogram Based Fuzzy Image Clustering," Knowledge-based Systems, vol. 216, p. 106814, DOI: 10.1016/j.knosys.2021.106814, 2021.

[16] L. U, Y. Chai and J. Chen, "Improved Personalized Recommendation Based on User Attributes Clustering and Score Matrix Filling," Computer Standards & Interfaces, vol. 57, pp. 59-67, 2018.

[17] Q. Wang, W. Cao and Y. Liu, "A Novel Clustering Based Collaborative Filtering Recommendation System Algorithm," Proc. of Advanced Technologies, Embedded and Multimedia, for Human-centric Computing, pp. 673-680, Part of the Lecture Notes in Electrical Engineering Book Series, vol. 260, Springer, Dordrecht, Netherlands, 2014.

[18] B. M. Sarwar, G. Karypis, J. Konstan and J. Riedl, "Recommender Systems for Large-scale E-commerce: Scalable Neighborhood Formation Using Clustering," Proceedings of the 5th International Conference on Computer and Information Technology (ICCIT), vol. 1, pp. 291-324, 2002.

[19] Z. Cui et al., "Personalized Recommendation System Based on Collaborative Filtering for IoT Scenarios," IEEE Transactions on Services Computing, vol. 13, no. 4, pp. 685-695, 2020.

[20] T. Mohammadpour, A. M. Bidgoli, R. Enayatifar and H. H. S. Javadi, "Efficient Clustering in Collaborative Filtering Recommender System: Hybrid Method Based on Genetic Algorithm and Gravitational Emulation Local Search Algorithm," Genomics, vol. 111, no. 6, pp. 1902-1912, 2019.

[21] D. Arthur and S. Vassilvitskii, "K-Means++: The Advantages of Careful Seeding," Proceedings of the 18th Annual ACM-SIAM Symposium on Discrete Algorithms, pp. 1027-1035, New Orleans, USA, 2007.

[22] V. Vijayakumar, V. Subramaniyaswamy, R. Logesh and A. Sivapathi, "Effective Knowledge Based Recommender System for Tailored Multiple Point of Interest Recommendation," International Journal of Web Portals (IJWP), vol. 11, no. 1, pp. 1-18, 2019.

[23] M. Dong, X. Zeng, L. Koehl and J. Zhang, "An Interactive Knowledge-based Recommender System for Fashion Product Design in the Big Data Environment," Information Sciences, vol. 540, pp. 469-488, 2020.

[24] A. Hassani, P. D. Haghighi, S. Ling, P. P. Jayaraman and A. Zaslavsky, "Querying IoT Services: A Smart Carpark Recommender Use Case," Proc. of the IEEE 4th World Forum on Internet of Things (WF-IoT), pp. 619-624, Singapore, 2018.

[25] A. Bellogín and A. Said, "Information Retrieval and Recommender Systems," Proc. of Data Science in Practice, pp. 79-96, Part of the Studies in Big Data Book Series, vol. 46, Cham: Springer International Publishing, 2019.

[26] R. Ying, R. He, K. Chen, P. Eksombatchai, W. L. Hamilton and J. Leskovec, "Graph Convolutional Neural Networks for Web-scale Recommender Systems," Proceedings of the 24th ACM SIGKDD International Conference on Knowledge Discovery & Data Mining, pp. 974-983, DOI: 10.1145/3219819.3219890, 2018.

[27] M. Nilashi, O. Ibrahim, E. Yadegaridehkordi, S. Samad, E. Akbari and A. Alizadeh, "Travelers Decision Making Using Online Review in Social Network Sites: A Case on TripAdvisor," Journal of Computational Science, vol. 28, pp. 168-179, 2018.

[28] M. Terzi, M. Rowe, M.-A. Ferrario and J. Whittle, "Text-based User-kNN: Measuring User Similarity Based on Text Reviews," Proc. of the International Conference on User Modeling, Adaptation and Personalization, pp. 195-206, Part of the Lecture Notes in Computer Science Book Series, vol. 8538, Cham, Springer International Publishing, 2014.

[29] C. Musto, M. d. Gemmis, G. Semeraro and P. Lops, "A Multi-criteria Recommender System Exploiting Aspect-based Sentiment Analysis of Users’ Reviews," Proceedings of the 11th ACM Conference on Recommender Systems, DOI: 10.1145/3109859.3109905, Como, Italy, 2017.

[30] A. H. Jadidinejad, C. Macdonald and I. Ounis, "Unifying Explicit and Implicit Feedback for Rating Prediction and Ranking Recommendation Tasks," Proceedings of the 2019 ACM SIGIR International Conference on Theory of Information Retrieval, [Online], Available: https://doi.org/10.1145/3341981.3344225, Santa Clara, CA, USA, 2019.

[31] D. Margaris, C. Vassilakis and D. Spiliotopoulos, "Handling Uncertainty in Social Media Textual Information for Improving Venue Recommendation Formulation Quality in Social Networks," Social Network Analysis and Mining, vol. 9, no. 1, p. 64, 2019.

[32] D. Chehal, P. Gupta and P. Gulati, "Implementation and Comparison of Topic Modeling Techniques Based on User Reviews in E-commerce Recommendations," Journal of Ambient Intelligence and Humanized Computing, vol. 2020, pp. 1-6, DOI: 10.1007/s12652-020-01956-6, 2020.

[33] M. Saraswat, S. Chakraverty and A. Sharma, "Review-based Topic Distribution Profile for Recommender Systems," Proc. of Advances in Data Sciences, Security and Applications, pp. 433-443, Part of the Lecture Notes in Electrical Engineering Book Series, vol. 612, Springer, Singapore, 2020.

[34] J. B. Schafer, D. Frankowski, J. Herlocker and S. Sen, "Collaborative Filtering Recommender Systems," Proc. of the Adaptive Web, pp. 291- 324, Part of the Lecture Notes in Computer Science Book Series, vol. 4321, Springer-Verlag, 2007.

[35] K. Peffers, T. Tuunanen, M. A. Rothenberger and S. Chatterjee, "A Design Science Research Methodology for Information Systems Research," Journal of Management Information Systems, vol. 24, no. 3, pp. 45-77, 2007.

[36] D. W. Aha, D. Kibler and M. K. Albert, "Instance-based Learning Algorithms," Machine Learning, vol. 6, no. 1, pp. 37-66, 1991.

[37] D. Jannach, M. Zanker, A. Felfernig and G. Friedrich, Recommender Systems: An Introduction, Cambridge University Press, DOI: 10.1017/CBO9780511763113, 2010.

[38] G. Salton, Automatic Text Processing: The Transformation, Analysis and Retrieval of Information by Computer, Addison-Wesley Longman Publishing Co., Inc., 1989.

[39] R. Baeza-Yates and B. Ribeiro-Neto, Modern Information Retrieval, New York: ACM Press: Addison- Wesley Longman Publishing, 1999.

[40] A. M. D. E. Hassanein and M. Nour, "A Proposed Model of Selecting Features for Classifying Arabic Text," Jordanian Journal of Computers and Information Technology (JJCIT), vol. 05, no. 03, pp. 275- 290, 2019.

[41] M. Srifi, A. Oussous, A. A. Lahcen and S. Mouline, "Recommender Systems Based on Collaborative Filtering Using Review Texts: A Survey," Information, vol. 11, no. 6, p. 317, 2020.

[42] M. Deshpande and G. Karypis, "Item-based Top-N Recommendation Algorithms," ACM Transactions on Information Systems, vol. 22, no. 1, pp. 143-177, 2004.

[43] B. Sarwar, G. Karypis, J. Konstan and J. Riedl, "Application of Dimensionality Reduction in Recommender System-a Case Study," Proceedings of the ACM WebKDD 2000 Web Mining for E- Commerce Workshop, DOI: 10.21236/ada439541, 2000.

[44] Y. Koren, R. Bell and C. Volinsky, "Matrix Factorization Techniques for Recommender Systems," Computer, vol. 42, no. 8, pp. 30-37, 2009.

[45] D. Bokde, S. Girase and D. Mukhopadhyay, "Matrix Factorization Model in Collaborative Filtering Algorithms: A Survey," Procedia Computer Science, vol. 49, pp. 136-146, 2015.

[46] R. Barathy and P. Chitra, "Applying Matrix Factorization in Collaborative Filtering Recommender Systems," Proc. of the IEEE 6th International Conference on Advanced Computing and Communication Systems (ICACCS), pp. 635-639, Coimbatore, India, 2020.

[47] V. X. Chen and T. Y. Tang, "Incorporating Singular Value Decomposition in User-based Collaborative Filtering Technique for a Movie Recommendation System: A Comparative Study," Proceedings of the 2019 International Conference on Pattern Recognition and Artificial Intelligence (PRAI'19), pp. 12-15, DOI: 10.1145/3357777.3357782, 2019.

[48] Z. Xian, Q. Li, G. Li and L. Li, "New Collaborative Filtering Algorithms Based on SVD++ and Differential Privacy," Mathematical Problems in Engineering, vol. 2017, pp. 136-146, 2017.

[49] X. Luo, M. Zhou, Y. Xia and Q. Zhu, "An Efficient Non-negative Matrix-factorization-based Approach to Collaborative Filtering for Recommender Systems," IEEE Transactions on Industrial Informatics, vol. 10, no. 2, pp. 1273-1284, 2014.

[50] W. Niu et al., "Context-aware Service Ranking in Wireless Sensor Networks," Journal of Network and Systems Management, vol. 22, no. 1, pp. 50-74, 2014. 165 "Enhancing Collaborative Filtering Recommendation Using Review Text Clustering", A. S. Ghabayen and B. H. Ahmed.