A Comprehensive Review of User Interaction for Recommendation Systems
DOI:
https://doi.org/10.5753/isys.2024.4064Keywords:
Recommendation systems, User behavior, User interaction, User feedbackAbstract
In recent years, Recommendation Systems have become integral to the online experiences of consumers, particularly those that effectively integrate user interactions into their algorithms, enhancing both efficiency and adaptability. This article presents a comprehensive systematic review of the literature addressing classical problems in recommendation systems, specifically focusing on the consideration of user interaction. We employed a rigorous systematic literature review methodology, critically analyzing various proposals to identify their limitations, characteristics, and potential avenues for further research. Our investigation involved mapping relevant studies that examine how user interaction with recommendation systems is addressed and determining the extent to which this aspect has been explored. We established strict inclusion and exclusion criteria to select academic publications, resulting in a curated set of 29 scientific papers. The findings offer a snapshot of the primary characteristics of the identified works, revealing significant gaps that can inform future research directions. Our analysis indicates that most studies addressing user interaction emphasize preference elicitation and feedback mechanisms, predominantly focusing on improving the accuracy of recommendation rankings, with a notable concentration on the e-commerce domain.
Downloads
References
Adomavicius, G. and Tuzhilin, A. (2005). Toward the next generation of recommender systems: A survey of the state-of-the-art and possible extensions. IEEE Transactions on Knowledge and Data Engineering, 17(6):734–749.
Adomavicius, G. and Tuzhilin, A. (2010). Context-aware recommender systems. In Recommender Systems Handbook, pages 217–253. Springer.
Adomavicius, G. and Tuzhilin, A. (2015). Context-Aware Recommender Systems, pages 191–226. Springer.
Aggarwal, C. C. (2016). Recommender systems: The textbook. Springer.
Albanese, M., Picariello, A., Sansone, C., and Sansone, L. (2004). Web personalization based on static information and dynamic user behavior. In Proceedings of the 6th Annual ACM International Workshop on Web Information and Data Management, pages 80–87. ACM.
Alonso, S., Cabrerizo, F. J., Chiclana, F., Herrera, F., and Herrera-Viedma, E. (2009). Group decision making with incomplete fuzzy linguistic preference relations. International Journal of Intelligent Systems, 24(2):201–222.
Baeza-Yates, R., Hurtado, C., Mendoza, M., and Dupret, G. (2005). Modeling user search behavior. In Third Latin American Web Congress (LA-WEB’2005), pages 10–pp. IEEE.
Baltrunas, L. and Amatriain, X. (2009). Towards time-dependent recommendation based on implicit feedback. In Workshop on Context-Aware Recommender Systems (CARS’09), pages 25–30. ACM.
Bobadilla, J., Ortega, F., Hernando, A., and Gutiérrez, A. (2013). Recommender systems survey. Knowledge-Based Systems, 46:109–132.
Cao, Z., Qiao, X., Jiang, S., and Zhang, X. (2019). An efficient knowledge-graph-based web service recommendation algorithm. Symmetry, 11(3).
Carrer-Neto, W., Hernández-Alcaraz, M. L., Valencia-García, R., and García-Sánchez, F. (2012). Social knowledge-based recommender system. Application to the movies domain. Expert Systems with Applications, 39(12):10990–11000.
Cavacini, A. (2015). What is the best database for computer science journal articles? Scientometrics, 102(3):2059–2071.
Chang, J., Gao, C., Zheng, Y., Hui, Y., Niu, Y., Song, Y., Jin, D., and Li, Y. (2021). Sequential recommendation with graph neural networks. In Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval, pages 378–387. ACM.
Chao, D. L., Balthrop, J., and Forrest, S. (2005). Adaptive radio: Achieving consensus using negative preferences. In Proceedings of the 2005 ACM International Conference on Supporting Group Work, pages 120–123. ACM.
Chen, S., Andrienko, N., Andrienko, G., Adilova, L., Barlet, J., Kindermann, J., Nguyen, P., Thonnard, O., and Turkay, C. (2020). LDA ensembles for interactive exploration and categorization of behaviors. IEEE Transactions on Visualization and Computer Graphics, 26(9):2775–2792.
Choi, K., Yoo, D., Kim, G., and Suh, Y. (2012). A hybrid online-product recommendation system: Combining implicit rating-based collaborative filtering and sequential pattern analysis. Electronic Commerce Research and Applications, 11(4):309–317.
Chong, S. and Abeliuk, A. (2019). Quantifying the effects of recommendation systems. In 2019 IEEE International Conference on Big Data (Big Data), pages 3008–3015.
Christensen, I. A. and Schiaffino, S. (2011). Entertainment recommender systems for group of users. Expert Systems with Applications, 38(11):14127–14135.
Crespo, R. G., Martínez, O. S., Lovelle, J. M. C., García-Bustelo, B. C. P., Gayo, J. E. L., and de Pablos, P. O. (2011). Recommendation system based on user interaction data applied to intelligent electronic books. Computers in Human Behavior, 27(4):1445–1449.
Dao, T. H., Jeong, S. R., and Ahn, H. (2012). A novel recommendation model of location-based advertising: Context-aware collaborative filtering using GA approach. Expert Systems with Applications, 39(3):3731–3739.
Deepak, G. and Santhanavijayan, A. (2022). UQSCM-RFD: A query–knowledge interfacing approach for diversified query recommendation in semantic search based on river flow dynamics and dynamic user interaction. Neural Computing and Applications, 34(1):651–675.
Delone, W. and McLean, E. (1992). Information systems success: The quest for the dependent variable. Information Systems Research, 3:60–95.
Diaper, D. and Stanton, N. (2003). The Handbook of Task Analysis for Human-Computer Interaction. Taylor Francis Group.
Diskin, Z. (2000). On mathematical foundations for business modeling. In Proceedings of the 37th International Conference on Technology of Object-Oriented Languages and Systems (TOOLS-Pacific 2000), pages 182–187.
Dumais, S., Jeffries, R., Russell, D. M., Tang, D., and Teevan, J. (2014). Understanding user behavior through log data and analysis. In Ways of Knowing in HCI, pages 349–372.
Fabbri, S., Silva, C., Hernandes, E., Octaviano, F., Di Thommazo, A., and Belgamo, A. (2016). Improvements in the START tool to better support the systematic review process. In Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering. ACM.
Feng, L. and Wei-wei, G. (2018). Retracted: Recommendation algorithm based on tag time weighting. In 2018 3rd International Conference on Smart City and Systems Engineering (ICSCSE), pages 755–758.
Feng, M., Peck, E., and Harrison, L. (2019). Patterns and pace: Quantifying diverse exploration behavior with visualizations on the web. IEEE Transactions on Visualization and Computer Graphics, 25(1):501–511.
Gan, M. and Xiao, K. (2019). R-RNN: Extracting user recent behavior sequence for click-through rate prediction. IEEE Access, 7:111767–111777.
Gao, C., Zheng, Y., Li, N., Li, Y., Qin, Y., Piao, J., Quan, Y., Chang, J., Jin, D., He, X., and Li, Y. (2023). A survey of graph neural networks for recommender systems: Challenges, methods, and directions. ACM Transactions on Recommender Systems, 1(1).
Ginty, L. M. and Smyth, B. (2002). Evaluating preference-based feedback in recommender systems. In Irish Conference on Artificial Intelligence and Cognitive Science, pages 209–214. Springer.
Go, G., Yang, J., Park, H., and Han, S. (2010). Using online media sharing behavior as implicit feedback for collaborative filtering. In 2010 IEEE Second International Conference on Social Computing, pages 439–445.
Guo, S. and Li, C. (2020). Hybrid recommendation algorithm based on user behavior. In 2020 IEEE 9th Joint International Information Technology and Artificial Intelligence Conference (ITAIC), volume 9, pages 2242–2246.
Hebrado, J. L., Lee, H. J., and Choi, J. (2011). The role of transparency and feedback on the behavioral intention to reuse a recommender system. In CONFIRM 2011 Proceedings. AIS eLibrary.
Hu, Y., Koren, Y., and Volinsky, C. (2008). Collaborative filtering for implicit feedback datasets. In 2008 Eighth IEEE International Conference on Data Mining, pages 263–272.
Hwangbo, H., Kim, Y. S., and Cha, K. J. (2018). Recommendation system development for fashion retail e-commerce. Electronic Commerce Research and Applications, 28:94–101.
ISO (2019). ISO 9241-210:2019, ergonomics of human-system interaction part 210: Human-centred design for interactive systems.
Jannach, D., Zanker, M., Felfernig, A., and Friedrich, G. (2011). An introduction to recommender systems. New York: Cambridge, 10:1941904.
Jawaheer, G., Szomszor, M., and Kostkova, P. (2010). Comparison of implicit and explicit feedback from an online music recommendation service. In Proceedings of the 1st International Workshop on Information Heterogeneity and Fusion in Recommender Systems, pages 47–51. ACM.
Jawaheer, G., Weller, P., and Kostkova, P. (2014). Modeling user preferences in recommender systems: A classification framework for explicit and implicit user feedback. ACM Transactions on Interactive Intelligent Systems, 4(2):47–51.
Jianjun, M. (2020). Research on collaborative filtering recommendation algorithm based on user behavior characteristics. In 2020 International Conference on Big Data Artificial Intelligence Software Engineering (ICBASE), pages 425–428.
Jin, J., Chen, X., Chen, Y., Zhang, W., Rui, R., Jiang, Z., Su, Z., and Yu, Y. (2022). Who to watch next: Two-side interactive networks for live broadcast recommendation. In Proceedings of the ACM Web Conference 2022, pages 3206–3216. ACM.
Jugovac, M., and Jannach, D. (2017a). Interacting with recommenders—overview and research directions. ACM Transactions on Interactive Intelligent Systems, 7(3).
Jugovac, M., and Jannach, D. (2017b). Interacting with recommenders—overview and research directions. ACM Transactions on Interactive Intelligent Systems, 7(3).
Kang, S., Jeong, C., and Chung, K. (2020). Tree-based real-time advertisement recommendation system in online broadcasting. IEEE Access, 8:192693–192702.
Kim, J., Oard, D. W., and Romanik, K. (2000). User modeling for information access based on implicit feedback. University of Maryland.
Kitchenham, B. A. (2012). Systematic review in software engineering: Where we are and where we should be going. In Proceedings of the 2nd International Workshop on Evidential Assessment of Software Technologies, pages 1–2. ACM.
Kitchenham, B. A., and Charters, S. (2007). Guidelines for performing systematic literature reviews in software engineering. Technical Report EBSE 2007-001, Keele University and Durham University Joint Report.
Koren, Y., Bell, R., and Volinsky, C. (2009). Matrix factorization techniques for recommender systems. Computer, 42(8):30–37.
Kumar, M., Ajmeri, N., and Ghaisas, S. (2010). Towards knowledge-assisted agile requirements evolution. In Proceedings of the 2nd International Workshop on Recommendation Systems for Software Engineering, pages 16–20. ACM.
Liu, N. N., Xiang, E. W., Zhao, M., and Yang, Q. (2010). Unifying explicit and implicit feedback for collaborative filtering. In Proceedings of the 19th ACM International Conference on Information and Knowledge Management, pages 1445–1448. ACM.
Liu, T., He, Z., and Wang, P. (2020). Sorrrs: Social recommendation incorporating rating similarity and user relationships analysis. In 2020 7th International Conference on Information, Cybernetics, and Computational Social Systems (ICCSS), pages 118–123.
Ma, P., Gao, Q., et al. (2020). EEG signal and feature interaction modeling-based eye behavior prediction research. Computational and Mathematical Methods in Medicine, 2020.
Meshram, R., and Kaza, K. (2021). Monte Carlo rollout policy for recommendation systems with dynamic user behavior. In 2021 International Conference on Communication Systems Networks (COMSNETS), pages 86–89.
Misztal-Radecka, J., and Indurkhya, B. (2020). Persona prototypes for improving the qualitative evaluation of recommendation systems. In Adjunct Publication of the 28th ACM Conference on User Modeling, Adaptation and Personalization, pages 206–212. ACM.
Mo, Y., Chen, J., Xie, X., Luo, C., and Yang, L. T. (2014). Cloud-based mobile multimedia recommendation system with user behavior information. IEEE Systems Journal, 8(1):184–193.
Moling, O., Baltrunas, L., and Ricci, F. (2012). Optimal radio channel recommendations with explicit and implicit feedback. In Proceedings of the Sixth ACM Conference on Recommender Systems, pages 75–82. ACM.
Neelima, G., and Rodda, S. (2016). Predicting user behavior through sessions using the web log mining. In 2016 International Conference on Advances in Human Machine Interaction (HMI), pages 1–5.
Nguyen, M.-D. and Cho, Y.-S. (2020). A hybrid generative model for online user behavior prediction. IEEE Access, 8:3761–3771.
Nguyen, T., Ngo Van, L., and Than, K. (2020). Modeling the sequential behaviors of online users in recommender systems. In Artificial Intelligence and Machine Learning for Multi-Domain Operations Applications II, volume 11413, pages 570–579. SPIE.
Nichols, D. (1998). Implicit rating and filtering. In Proceedings of the 5th DELOS Workshop on Filtering and Collaborative Filtering. ERCIM.
Oard, D. W. and Kim, J. (1998). Implicit feedback for recommender systems. University Libraries of South Carolina.
Oard, D. W. and Kim, J. (2001). Modeling information content using observable behavior. Journal of the Association for Information Science and Technology.
Oh, J., Lee, S., and Lee, E. (2008). A user modeling using implicit feedback for effective recommender system. In 2008 International Conference on Convergence and Hybrid Information Technology, pages 155–158.
Ortiz Viso, B. (2020). Evolutionary approach in recommendation systems for complex structured objects. In Fourteenth ACM Conference on Recommender Systems, pages 776–781. ACM.
Parra, D. and Amatriain, X. (2011). Walk the talk: Analyzing the relation between implicit and explicit feedback for preference elicitation. In Proc. of User Modeling, Adaption and Personalization: 19th International Conference, UMAP 2011, Girona, Spain, pages 255–268. Springer.
Parra, D., Karatzoglou, A., Amatriain, X., and Yavuz, I. (2011). Implicit feedback recommendation via implicit-to-explicit ordinal logistic regression mapping. Proc. of the CARS-2011, 5.
Parush, A. (2015). Chapter 13 - First, user research. Just do it. In Conceptual Design for Interactive Systems, pages 79–88. Morgan Kaufmann.
Patro, S. G. K., Mishra, B. K., Panda, S. K., Kumar, R., Long, H. V., Taniar, D., and Priyadarshini, I. (2020). A hybrid action-related k-nearest neighbour (har-knn) approach for recommendation systems. IEEE Access, 8(1):90978–90991.
Peng, D., Yuan, W., and Liu, C. (2019). Harsam: A hybrid model for recommendation supported by self-attention mechanism. IEEE Access, 7:12620–12629.
Pu, P., Chen, L., and Hu, R. (2011). A user-centric evaluation framework for recommender systems. In Proceedings of the Fifth ACM Conference on Recommender Systems, RecSys ’11, pages 157–164. ACM.
Qian Gao, P. M. (2021). Graph neural network and context-aware user behavior prediction and recommendation system research. In Computational Intelligence and Neuroscience, volume 2020, page 14. Hindawi.
Rashid, A. M., Karypis, G., and Riedl, J. (2008). Learning preferences of new users in recommender systems: An information theoretic approach. ACM SIGKDD Explorations Newsletter, 10(2):90–100.
Reese, D. D., Pawluk, D. T., and Taylor, C. R. (2016). Chapter 6 - Engaging learners through rational design of multisensory effects. In Tettegah, S. Y. and Noble, S. U. (Eds.), Emotions, Technology, and Design, pages 103–127. Academic Press, San Diego.
Ricci, F., Rokach, L., and Shapira, B. (2022). Recommender Systems: Techniques, Applications, and Challenges, pages 1–35. Springer.
Rocha Silva, T., Winckler, M., and Bach, C. (2020). Evaluating the usage of predefined interactive behaviors for writing user stories: An empirical study with potential product owners. Cognition, Technology Work, 22:437–457.
Rocha Silva, T., Winckler, M., and Trætteberg, H. (2020). Ensuring the consistency between user requirements and task models: A behavior-based automated approach. Proc. ACM Hum.-Comput. Interact., 4.
Sabitha, R., Vaishnavi, S., Karthik, S., and Bhavadharini, R. (2022). User interaction based recommender system using machine learning. Intelligent Automation Soft Computing, 31(2):1037–1049.
Saranya, Sowmya, A. S., Mohammed Shebin, K. K., and Mohan, A. (2020). Social recommendation system using network embedding and temporal information. In 2020 5th International Conference on Computing, Communication and Security (ICCCS), pages 1–7.
Schoinas, I. and Tjortjis, C. (2019). Musif: A product recommendation system based on multi-source implicit feedback. In Proc. of Artificial Intelligence Applications and Innovations: 15th IFIP WG 12.5 International Conference, AIAI 2019, Greece, pages 660–672. Springer.
Setiowati, S., Adji, T. B., and Ardiyanto, I. (2018). Context-based awareness in location recommendation system to enhance recommendation quality: A review. In 2018 International Conference on Information and Communications Technology (ICOIACT), pages 90–95. IEEE.
Shibamoto, E., Kittirojrattana, C., Koopipat, C., Hansuebsai, A., and Takano, K. (2019). A recommendation system of sightseeing places based on user’s behavior of taking and editing photos. In IEEE Pacific Rim Conference on Communications, Computers and Signal Processing (PACRIM), pages 1–6.
Silva, T. R. and Winckler, M. (2022). Assessing user interface design artifacts: A tool-supported behavior-based approach.
Sinha, B. B. and Dhanalakshmi, R. (2019). Evolution of recommender system over the time. Soft Computing, 23(23):12169–12188.
Su, Z., Lin, Z., Ai, J., and Li, H. (2021). Rating prediction in recommender systems based on user behavior probability and complex network modeling. IEEE Access, 9:30739–30749.
Swearingen, K. and Sinha, R. (2002). Interaction design for recommender systems. In Designing Interactive Systems, pages 312–334.
Tarus, J. K., Niu, Z., and Kalui, D. (2018). A hybrid recommender system for e-learning based on context awareness and sequential pattern mining. Soft Computing, 22:2449–2461.
Walek, B. (2017). Creating adaptive web recommendation system based on user behavior. Journal of Physics: Conference Series, 933:012014.
Wang, X., Li, Q., Yu, D., and Xu, G. (2022). Off-policy learning over heterogeneous information for recommendation. In Proc. of the ACM Web Conference 2022, pages 2348–2359. ACM.
Wang, Y., Shang, W., and Li, Z. (2016). The application of factorization machines in user behavior prediction. In 2016 IEEE/ACIS 15th International Conference on Computer and Information Science (ICIS), pages 1–4.
Wang, Y., Stash, N., Aroyo, L., Hollink, L., and Schreiber, G. (2009). Semantic relations for content-based recommendations. In Proc. of the Fifth International Conference on Knowledge Capture, page 209–210. ACM.
Widiyaningtyas, T., Hidayah, I., and Adji, T. B. (2021). User profile correlation-based similarity (UPCSim) algorithm in movie recommendation system. Journal of Big Data, 8(1):52.
Wohlin, C. (2014). Guidelines for snowballing in systematic literature studies and a replication in software engineering. Proc. of the 18th International Conference on Evaluation and Assessment in Software Engineering.
Wu, S., Liu, Q., Wang, L., and Tan, T. (2016). Contextual operation for recommender systems. IEEE Transactions on Knowledge and Data Engineering, 28(8):2000–2012.
Xie, Y., Wang, Z., Yang, C., Li, Y., Ding, B., Deng, H., and Han, J. (2022). Komen: Domain knowledge guided interaction recommendation for emerging scenarios. In Proc. of the ACM Web Conference 2022, pages 1301–1310. ACM.
Xu, X., Chikersal, P., Doryab, A., Villalba, L., and Lee, J. (2022). Deep hybrid collaborative filtering with interactions over implicit feedback for recommender systems. IEEE Transactions on Neural Networks and Learning Systems, 33(5):2011–2022.
Xu, X., Chikersal, P., Doryab, A., Villalba, D. K., Dutcher, J. M., Tumminia, M. J., Althoff, T., Cohen, S., Creswell, K. G., Creswell, J. D., et al. (2019). Leveraging routine behavior and contextually-filtered features for depression detection among college students. Proc. of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 3(3):1–33.
Xu, X., Hassan Awadallah, A., T. Dumais, S., Omar, F., Popp, B., Rounthwaite, R., and Jahanbakhsh, F. (2020). Understanding user behavior for document recommendation. In Proc. of The Web Conference 2020, page 3012–3018. ACM.
Yang, Z. and Zhang, M. (2020). Textog: A recommendation model for rating prediction based on heterogeneous fusion of review data. IEEE Access, 8:159566–159573.
Yi, P., Li, C., Yang, C., and Chen, M. (2015). An optimization method for recommendation system based on user implicit behavior. In 2015 Fifth International Conference on Instrumentation and Measurement, Computer, Communication and Control (IMCCC), pages 1537–1540.
Zheng, L., Noroozi, V., and Yu, P. S. (2017). Joint deep modeling of users and items using reviews for recommendation. In Proc. of the Tenth ACM International Conference on Web Search and Data Mining, page 425–434. ACM.
Zheng, R., Qu, L., Cui, B., Shi, Y., and Yin, H. (2023). AutoML for deep recommender systems: A survey. ACM Trans. Inf. Syst., 41(4).
Zheng, Z., Ma, H., Lyu, M., and King, I. (2009). Wsrec: A collaborative filtering based web service recommender system. In 2009 IEEE international conference on web services, pages 437–444. IEEE.
Zhou, D., Hao, S., Zhang, H., Dai, C., An, Y., Ji, Z., and Ganchev, I. (2021). Novel sddm rating prediction models for recommendation systems. IEEE Access, 9:101197–101206.
Zhu, Q., Zhang, H., He, Q., and Dou, Z. (2022). A gain-tuning dynamic negative sampler for recommendation. In Proc. of the ACM Web Conference 2022, page 277–285.
Zhuo, J., Zhu, Q., Yue, Y., and Zhao, Y. (2022). Learning explicit user interest boundary for recommendation. In Proc. of the ACM Web Conference 2022, page 193–202. ACM.
Downloads
Published
How to Cite
Issue
Section
License
Copyright (c) 2024 iSys - Brazilian Journal of Information Systems
This work is licensed under a Creative Commons Attribution 4.0 International License.
