A Review of the Emotion-Induced Music Recommendation Systems

Pit Pichappan

Pit Pichappan Digital Information Research Labs., Chennai. India

Abstract

This review discusses the evolution, approaches, methodologies, features, and outcomes of emotion-induced music recommendation systems (MRS) in light of the growing demand for personalised music experiences. Traditional MRS often overlook the emotional context of users, making the integration of emotion recognition a promising enhancement for user satisfaction. The paper examines 32 studies published between 2011 and 2025, detailing how various inputs, such as facial expressions and physiological signals, can inform personalised music recommendations. It highlights the application of advanced machine learning techniques and the challenges that arise, including the cold-start problem and the need for real-time processing capabilities. The review categorises existing systems into content-based filtering, sequential recommendations, and emotion detection using physiological signals. Additionally, it emphasises the importance of context-aware recommen der systems that factor in user environments. Future research is encouraged to address limitations in accuracy, scalability, and ethical considerations while exploring multimodal approaches for more robust MRS. Ultimately, the review highlights the transformative potential of emotion-based music recommendation systems (MRS) in enhancing user interaction and personalisation with digital music platforms.

References

[1] Hu, Yajie., Ogihara, Mitsunori., Ogihara, Mitsunori. (2011). NextOne Player: A music recommendation system based on user behavior. In: Proceedings of the 12th International Society for Music Information Retrieval Conference (ISMIR 2011), Miami, Florida, USA, October 24–28, 2011. [2] Kathavate, Sheela. (2021). Music recommendation system using content and collaborative filtering methods. International Journal of Engineering Research & Technology, 10 (02) February 2021. [3] Raut, Roshani., Goel, Dhruv. (2023). Mood-based emotional analysis for music recommendation: Moodbased music recommendation system using facial expression analysis. Easy Chair Preprint No. 10377. [4] Ayata, D., Yaslan, Y., Kamasak, M. E. (2018). Emotion-based music recommendation system using wearable physiological sensors. IEEE Transactions on Consumer Electronics, 64 (2) 196–203. https://doi.org/10.1109/ TCE.2018.2844736 [5] Singh, A., Sharma, R., Pandey, M. S., Asthana, S., Gitanjali., Vishwakarma, A. (2024). Facial expressionbased music recommendation system using deep learning. In Namasudra, S., Trivedi, M. C., Crespo, R. G., Lorenz, P. (Eds.), Data Science and Network Engineering. ICDSNE 2023. Lecture Notes in Networks and Systems. Vol. 791. Springer, Singapore. [6] Lee, Jongseol., Yoon, Kyongro., Jang, Dalwon., Jang, Sei-Jin., Shin, Saim., Kim, Ji-Hwan. (2018).Music recommendation system based on genre distance and user preference classification. Journal of Theoretical and Applied Information Technology, 96 (5) March 15, 2018. [7] Kumar, Ajay., Singhal, Kanika., Upadhyay, Nishant., Kushwah, Kirti. (2023). Music recommendation using facial expression. IPEC Journal of Science & Technology, 2 (2) 52. [8] Schedl, Markus. (2019). Deep learning in music recommendation systems. Frontiers in Applied Mathematics and Statistics, 5, August 29. [9] Singh, A., Sharma, R., Pandey, M. S., Asthana, S., Gitanjali., Vishwakarma, A. (2024). Facial expressionbased music recommendation system using deep learning. In Namasudra, S., Trivedi, M. C., Crespo, R. G., Lorenz, P. (Eds.), Data Science and Network Engineering. ICDSNE 2023. Lecture Notes in Networks and Systems. Vol. 791. Springer, Singapore. [10] McKay, Cory. (2023). Music genre classification using k-nearest-neighbors. Highlights in Science Engineering and Technology. [11] Verma, Varsha., et al. (2021). Music recommendation system using machine learning. International Journal of Scientific Research in Computer Science, Engineering and Information Technology (IJSRCSEIT). [12] Lozano Murciego, Á., Jiménez-Bravo, D. M., Valera Román, A., De Paz Santana, J. F., Moreno-García, M. N. (2021). Context-aware recommender systems in the music domain: A systematic literature review. Electronics, 10, 1555. [13] Liang, Minshu., Zhan, Daniel P. W., Ellis, Dawen. (2015). Content-aware collaborative music recommendation using pre-trained neural networks. In: Proceedings of the 16th International Society for Music Information Retrieval Conference, October 26–30, 2015, Málaga, Spain, p. 295. [14] Afchar, D., Melchiorre, A., Schedl, M., Hennequin, R., Epure, E., Moussallam, M. (2022). Explainability in music recommender systems. AI Magazine, 43 (2) 190–208. [15] Schedl, M., Knees, P., McFee, B., Bogdanov, D. (2022). Music recommendation systems: Techniques, use cases, and challenges. In Ricci, F., Rokach, L., Shapira, B. (Eds.), Recommender Systems Handbook. Springer, New York, NY. [16] Arun and Krishnamoorthy, R. (2022). Personalized music recommendation model based on machine learning. In: 2022 8th International Conference on Smart Structures and Systems (ICSSS), Chennai, India, p. 1–6. [17] Wang, Xinxi., Wang, Yi., Hsu, David., Wang, Ye. (2014). Exploration in interactive personalized music recommendation: A reinforcement learning approach. Association for Computing Machinery, 11 (1) August 2014. [18] Wen, X. (2021). Using deep learning approach and IoT architecture to build the intelligent musicrecommendation system. Soft Computing, 25, 3087–3096. [19] Kumar, R., Rakesh. (2022). Music recommendation system using machine learning. In: 2022 4th International Conference on Advances in Computing, Communication Control and Networking (ICAC3N), Greater Noida, India, pp. 572–576. [20] Agrafioti, F., Hatzinakos, D., Anderson, A. K. (2011). ECG pattern analysis for emotion detection. IEEE Transactions on Affective Computing, 3, 102–115. [21] Lin, Y.P., Wang, C.H., Jung, T.P., Wu, T.L., Jeng, S.K., Duann, J.R., Chen, J.H. (2010). EEG-based emotion recognition in music listening. IEEE Transactions on Biomedical Engineering, 57 (7) 1798–1806. [22] Wijnalda, G., Pauws, S., Vignoli, F., Stuckenschmidt, H. (2005). A personalized music system for motivation in sport performance. IEEE Pervasive Computing, 4 (3) 26–32. [23] Yang, Y.H., Lin, Y.C., Su, Y.F., Chen, H.H. (2008). A regression approach to music emotion recognition. IEEE Transactions on Audio, Speech, and Language Processing, 16 (2) 448–457. [24] Deng, J.J., Leung, C.H. (2013). Music retrieval in joint emotion space using audio features and emotional tags. In: Proceedings of the International Conference on Multimedia Modeling (pp. 524–534). Springer. [25] Deng, J.J., Leung, C.H., Milani, A., Chen, L. (2015). Emotional states associated with music: Classification, prediction of changes, and consideration in recommendation. ACM Transactions on Interactive Intelligent Systems (TiiS), 5(1) 1–36. [26] Rumiantcev, Mikhail., Khriyenko, Oleksiy. (2020). Emotion-based music recommendation system. In: Conference of Open Innovations Association (p. 639–645). [27] Kuo, Fang-Fei., Chiang, Meng-Fen., Shan, Man-Kwan., Lee, Suh-Yin. (2005). Emotion-based music recommendation by association discovery from film music. Association for Computing Machinery, New York. [28] Madipally, Sai Krishna Sashank., Maddila, Vijay., Krishnasai, P., Karthika, G. (2022). Mood-based music recommendation system using facial expression recognition and text sentiment analysis. Journal of Theoretical and Applied Information Technology, 100 (19) 5667–5674. [29] Swathi, Patakamudi., Sai Tejaswi, Dara., Amanulla Khan, Mohammad., Anguraj, Mohammad. A research on a music recommendation system based on facial expressions through deep learning mechanisms. Augmented Reality, 2, 38. https://doi.org/10.56294/gr202438 [30] McKay, C., Cumming, J., Fujinaga, I. (2018). jSymbolic 2.2: Extracting features from symbolic music for use in musicological and MIR research. In: Proceedings of the 19th International Society for Music Information Retrieval Conference (ISMIR) (pp. 348–354). [31] Yadav, R.R. (2024). Automatic music recommendation system algorithm using facial expression basedon machine learning. International Journal for Research in Applied Science and Engineering Technology, 12 (4) 3327–3331. https://doi.org/10.22214/ijraset.2024.60640 [32] Afoudi, Yassine., Lazaar, Mohamed., Al Achhab, Mohamed. (2021). Hybrid recommendation system combined content-based filtering and collaborative prediction using artificial neural network. Simulation Modelling Practice and Theory, 113, 102375. [32] Lozano Murciego, Á., Jiménez-Bravo, D.M., Valera Román, A., De Paz Santana, J.F., Moreno-García, M.N. (2021). Context-aware recommender systems in the music domain: A systematic literature review. Electronics, 10, 1555. [34] Anand, R., Sabeenian, R.S., Gurang, D., Kirthika, R., Rubeena, S. (2021). AI-based music recommendation system using deep learning algorithms. IOP Conference Series: Earth and Environmental Science, 785, 012013.International Conference on Innovative Research on Renewable Energy Technologies 25-27 February 2021, Malda, West Bengal, India. R Anand et al 2021 IOP Conf. Ser..: Earth Environ. Sci. 785 012013 [35] Niyazov, A., Mikhailova, E., Egorova, O. (2021). Content-based music recommendation system. In: 2021 29th Conference of Open Innovations Association (FRUCT) (p. 274–279). IEEE. [36] Magadum, B. H., Azad, H. K., Patel, H., et al. (2024). Music recommendation using dynamic feedback and content-based filtering. Multimedia Tools and Applications, 83, 77469–77488. [37] Wang, C. D., Zhang, X., Wan, Y., Yu, D., Xu, G., Deng, S. (2022). Modeling sequential listening behaviors with attentive temporal point process for next and next new music recommendation. IEEE Transactions on Multimedia, 24, 4170–4182. [38] Hanjalic, A., Xu, L. Q. (2005). Affective video content representation and modeling. IEEE Transactions on Multimedia, 7, 143–154. [39] Lu, L., Liu, D., Zhang, H. J. (2005). Automatic mood detection and tracking of music audio signals. IEEE Transactions on Audio, Speech, and Language Processing, 14, 5–18. [40] Yang, Y. H., Chen, H. H. (2010). Ranking-based emotion recognition for music organization and retrieval. IEEE Transactions on Audio, Speech, and Language Processing, 19, 762–774 [41] Yang, Y. H., Chen, H. H. (2012). Machine recognition of music emotion: A review. ACM Transactions on Intelligent Systems and Technology, 3, 1–30. [42] Savery, R., Rose, R., Weinberg, G. (2019). Establishing human-robot trust through music-driven robotic emotion prosody and gesture. In: Proceedings of the 2019 28th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN) p. 1–7. IEEE. [43] Subramaniam, G., Verma, J., Chandrasekhar, N., Narendra, K., George, K. (2018). Generating playlists on the basis of emotion. In: Proceedings of the 2018 IEEE Symposium Series on Computational Intelligence (SSCI) p. 366–373. IEEE.[57] Subramaniam, G., Verma, J., Chandrasekhar, N., Narendra, K., George, K. (2018). Generating playlists on the basis of emotion. In: Proceedings of the 2018 IEEE Symposium Series on Computational Intelligence (SSCI) p. 366–373). IEEE. [58] Zhang, Ting. (2018). Facial expression recognition based on deep learning: A survey. Advances in Intelligent Systems and Computing. Conference: International Conference on Intelligent and Interactive Systems and Applications. [59] Ahmed, Mumtahina., Rozario, Uland., Kabir, MD Mohsin., Aung, Zeyar., Shin, Jungpil., Mridha, M. F. (2024). Musical genre classification using advanced audio analysis and deep learning techniques. IEEE Open Journal of the Computer Society, 5, 457. [60] Athavle, M. (2021). Music recommendation based on face emotion recognition. Journal of Informatics Electrical and Electronics Engineering (JIEEE), 2(2) 1–11. [61] Chauhan, S., Mangrola, R., Viji, D. (2021). Analysis of intelligent movie recommender system from facial expression. In: Proceedings of the 2021: 5th International Conference on Computing Methodologies and Communication (ICCMC) (pp. 1454–1461). IEEE. [62] Moscato, V., Picariello, A., Sperlí, G. (2021). An emotional recommender system for music. IEEE Intelligent Systems, 36(5) 57–68. [63] Liu, Y.-J., Yu, M., Zhao, G., Song, J., Ge, Y., Shi, Y. (2018). Real-time movie-induced discrete emotion recognition from EEG signals. IEEE Transactions on Affective Computing, 9 (4) 550–562. [64] Hu, Yajie., Ogihara, Mitsunori. (2011). NextOne Player: A music recommendation system based on user behavior. In: Proceedings of the 12th International Society for Music Information Retrieval Conference, ISMIR 2011 p. 1–7. Miami, Florida, USA. [65] Rosa, R. L., Rodriguez, D. Z., Bressan, G. (2015). Music recommendation system based on user’s sentiments extracted from social networks. IEEE Transactions on Consumer Electronics, 61 (3) 359–367. [66] Bharti, Santosh Kumar, Varadhaganapathy, S., Rajeev Gupta, Shukla, Prashant Kumar, Lakshmaiah, Koneru, Bouye, Mohamed, Hinga, Simon Karanja, & Mahmoud, Amena MahmoudAmena Mahmoud. (2022). Text-based emotion recognition using deep learning approach. Computational Intelligence and Neuroscience, 45–60. 1–8. [67] Su, H., Chang, Y., Tseng, V. S. (2016). Effective social content-based collaborative filtering for music recommendation. Intelligent Data Analysis. https://doi.org/10.3233_IDA-170878 [68] Zhang, Ran. (2023). Facial emotion detection based on improved VGG-16. Applied and Computational Engineering, 21(1) 86–92. [69] Ge, Huilin., Zhu, Zhiyu., Dai, Yuewei., Wang, Biao., Wu, Xuedong. (2022). Facial expression recognitionbased on deep learning. Computer Methods and Programs in Biomedicine, 215, 106621. [70] Shirwadkar, A., Shinde, P., Desai, S., Jacob, S. (2022). Emotion based music recommendation system. International Journal for Research in Applied Science and Engineering Technology, 10 (12) 690–694. [71] Hassouneh, Aya., Mutawa, A. M., Murugappan, M. (2020). Development of a real-time emotion recognition system using facial expressions and EEG based on machine learning and deep neural network methods. Informatics in Medicine Unlocked, 20, 100372. [72] Zhang, Shuting., Liu, Kechen Liu., Yu, Zekai., Feng, Bowen., Ou, Zijie. (2023). Hybrid recommendation system combining collaborative filtering and content-based recommendation with keyword extraction. Applied and Computational Engineering, 2 (1) 927–939. [73] Fang, B., Zhao, Y., Han, G., He, J. (2023). Expression-guided deep joint learning for facial expression recognition. Sensors, 23, 7148. [74] Li, Pang., Mohd Noah, Shahrul Azman., Mohd Sarim, Hafiz. (2024). A survey on deep neural networks in collaborative filtering recommendation systems. [75] Nofal, M. H., Baizal, Z. K. A., Dharayani, R. (2021). Multi criteria recommender system for music using Knearest neighbors and weighted product method. Indonesian Journal on Computing (Indo-JC), 6 (2) 33–42. [76] Hebri, Dheeraj., Nuthakki, Ramesh., Reddy, C. Raghavendra. (2024). Effective facial expression recognition system using machine learning. EAI Endorsed Transactions on Internet of Things. [77] Florence, S. Metilda., Mohan, Uma. (2020). Emotional detection and music recommendation system based on user facial expression. IOP Conference Series Materials Science and Engineering, 912 (6) 062007. [78] Pandeya, Y. R., Bhattarai, B., Lee, J. (2021). Deep-learning-based multimodal emotion classification for music videos. Sensors, 21, 4927. [79] Salehi, M. (2013). An effective recommendation based on user behavior: A hybrid of sequential pattern of user and attributes of product. International Journal of Business Information Systems, 14 (4) 480–496. [80] Bakariya, B., Singh, A., Singh, H., et al. (2024). Facial emotion recognition and music recommendation system using CNN-based deep learning techniques. Evolving Systems, 15, 641–658. [81] Wang, S., Xu, C., Ding, A. S., Tang, Z. (2021). A novel emotion-aware hybrid music recommendation method using deep neural network. Electronics, 10, 1769. [82] Gorasiya, T., Gore, A., Ingale, D., Trivedi, M. (2022). Music recommendation based on facial expression using deep learning. In: 2022 7th International Conference on Communication and Electronics Systems (ICCES), Coimbatore, India, 1159–1165.[83] Chikaraddi, A., Janakki, S. G., Kanakaraddi, S. G., M, P. S. (2025). Emotion-driven music recommender system with deep learning and Streamlit integration. In: International Conference on Multi-Agent Systems for Collaborative Intelligence (ICMSCI), Erode, India, 1661–1668. [84] Volta, E., Di Stefano, N. (2024). Using wearable sensors to study musical experience: A systematic review. Sensors, 24, 5783. [85] Hayes, Ben., Shier, Jordie., Fazekas, György., McPherson, Andrew., Saitis, Charalampos. (2024). A review of differentiable digital signal processing for music and speech synthesis. Frontiers in Signal Processing, 11, Article 5783. https://doi.org/10.3389/fcomp.2023.1118996 [86] Elbir, A., Çam, H. Bilal., Iyican, M. Emre., Öztürk, B., Aydin, N. (2018). Music genre classification and recommendation by using machine learning techniques. In 2018 Innovations in Intelligent Systems and Applications Conference (ASYU), Adana, Turkey, 1–5. [87] Khanzada, Amil., Bai, Charles., Celepcikay, Ferhat Turke. (2024). Facial expression recognition with deep learning: Improving on the state of the art and applying to the real world. Stanford University - CS230 Deep Learning. https://arxiv.org/abs/2004.11823 [88] Wang, XuMing., Huang, Jin., Zhu, Jia., Yang, Min., Yang, Fen. (2018). Facial expression recognition with deep learning. Association for Computing Machinery, New York, NY, USA. [89] Ferraro, Andres., Bogdanov, Dmitry., Choi, Kyumin., Serra, Xavier. (2019). Using offline metrics and user behavior analysis to combine multiple systems for music recommendation. https://arxiv.org/abs/ 1901.02296. [90] Thakker, U., Patel, R., Shah, M. (2021). A comprehensive analysis on movie recommendation system employing collaborative filtering. Multimedia Tools and Applications, 80, 28647–28672. [91] Liberati, A., Altman, D. G., Tetzlaff, J., Mulrow, C., Gøtzsche, P. C., Ioannidis, J. P., Clarke, M., Devereaux, P. J., Kleijnen, J., Moher, D. (2009). The PRISMA statement for reporting systematic reviews and metaanalyses of studies that evaluate health care interventions: Explanation and elaboration. PLoS Medicine, 6 (7) e1000100.