skip to main content
10.1145/3209978.3210017acmconferencesArticle/Chapter ViewAbstractPublication PagesirConference Proceedingsconference-collections
research-article

Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks

Published: 27 June 2018 Publication History

Abstract

With the revival of neural networks, many studies try to adapt powerful sequential neural models, ıe Recurrent Neural Networks (RNN), to sequential recommendation. RNN-based networks encode historical interaction records into a hidden state vector. Although the state vector is able to encode sequential dependency, it still has limited representation power in capturing complicated user preference. It is difficult to capture fine-grained user preference from the interaction sequence. Furthermore, the latent vector representation is usually hard to understand and explain. To address these issues, in this paper, we propose a novel knowledge enhanced sequential recommender. Our model integrates the RNN-based networks with Key-Value Memory Network (KV-MN). We further incorporate knowledge base (KB) information to enhance the semantic representation of KV-MN. RNN-based models are good at capturing sequential user preference, while knowledge-enhanced KV-MNs are good at capturing attribute-level user preference. By using a hybrid of RNNs and KV-MNs, it is expected to be endowed with both benefits from these two components. The sequential preference representation together with the attribute-level preference representation are combined as the final representation of user preference. With the incorporation of KB information, our model is also highly interpretable. To our knowledge, it is the first time that sequential recommender is integrated with external memories by leveraging large-scale KB information.

References

[1]
Antoine Bordes, Nicolas Usunier, Alberto Garc'ıa-Durán, Jason Weston, and Oksana Yakhnenko . 2013. Translating Embeddings for Modeling Multi-relational Data NIPS. 2787--2795.
[2]
Jingyuan Chen, Hanwang Zhang, Xiangnan He, Wei Liu, Wei Liu, and Tat Seng Chua . 2017. Attentive Collaborative Filtering: Multimedia Recommendation with Item- and Component-Level Attention. In SIGIR. 335--344.
[3]
Xu Chen, Hongteng Xu, Yongfeng Zhang, Jiaxi Tang, Yixin Cao, Zheng Qin, and Hongyuan Zha . 2018. Sequential Recommendation with User Memory Networks WSDM.
[4]
Kyunghyun Cho, Bart Van Merrienboer, Dzmitry Bahdanau, and Yoshua Bengio . 2014. On the Properties of Neural Machine Translation: Encoder-Decoder Approaches. Computer Science (2014).
[5]
Tim Donkers, Benedikt Loepp, and Jürgen Ziegler . 2017. Sequential User-based Recurrent Neural Network Recommendations ACM RecSys.
[6]
John C. Duchi, Elad Hazan, and Yoram Singer . 2011. Adaptive Subgradient Methods for Online Learning and Stochastic Optimization. Journal of Machine Learning Research Vol. 12 (2011), 2121--2159.
[7]
Junyu Gao, Tianzhu Zhang, and Changsheng Xu . 2017. A Unified Personalized Video Recommendation via Dynamic Recurrent Neural Networks ACM MM.
[8]
Google . 2016. Freebase Data Dumps. https://developers.google.com/freebase/data. (2016).
[9]
F. Maxwell Harper and Joseph A. Konstan . 2016. The MovieLens Datasets. TiiS Vol. 5, 4 (2016), 1--19.
[10]
Ruining He, Wang Cheng Kang, and Julian Mcauley . 2017 a. Translation-based Recommendation. In ACM RecSys.
[11]
Ruining He and Julian Mcauley . 2016. Ups and Downs: Modeling the Visual Evolution of Fashion Trends with One-Class Collaborative Filtering. In WWW.
[12]
Xiangnan He, Lizi Liao, Hanwang Zhang, Liqiang Nie, Xia Hu, and Tat Seng Chua . 2017 b. Neural Collaborative Filtering. In WWW. 173--182.
[13]
Jonathan L Herlocker, Joseph A Konstan, Al Borchers, and John Riedl . 1999. An algorithmic framework for performing collaborative filtering SIGIR. 230--237.
[14]
Jonathan L. Herlocker, Joseph A. Konstan, and John Riedl . 2000. Explaining collaborative filtering recommendations CSCW. 241--250.
[15]
Balázs Hidasi, Alexandros Karatzoglou, Linas Baltrunas, and Domonkos Tikk . 2015. Session-based Recommendations with Recurrent Neural Networks. Computer Science (2015).
[16]
Sepp Hochreiter and Jürgen Schmidhuber . 1997. Long Short-Term Memory. Neural Computation (1997), 1735--1780.
[17]
Yehuda Koren, Robert Bell, and Chris Volinsky . 2009. Matrix Factorization Techniques for Recommender Systems. Computer (2009), 30--37.
[18]
Jing Li, Pengjie Ren, Zhumin Chen, Zhaochun Ren, and Jun Ma . 2017. Neural Attentive Session-based Recommendation. In CIKM.
[19]
Fei Liu and Julien Perez . 2016. Gated End-to-End Memory Networks. In EACL.
[20]
Qiang Liu, Shu Wu, Diyi Wang, Zhaokang Li, and Liang Wang . 2016. Context-Aware Sequential Recommendation. In ICDM. 1053--1058.
[21]
Alexander Miller, Adam Fisch, Jesse Dodge, Amir Hossein Karimi, Antoine Bordes, and Jason Weston . 2016. Key-Value Memory Networks for Directly Reading Documents EMNLP. 1400--1409.
[22]
Massimo Quadrana, Alexandros Karatzoglou, Balázs Hidasi, and Paolo Cremonesi . 2017. Personalizing Session-based Recommendations with Hierarchical Recurrent Neural Networks. In RecSys. 130--137.
[23]
Massimo Quadrana, Domonkos Tikk, and Domonkos Tikk . 2016. Parallel Recurrent Neural Network Architectures for Feature-rich Session-based Recommendations ACM Conference on Recommender Systems. 241--248.
[24]
Steffen Rendle . 2012. Factorization Machines with libFM. ACM TIST (2012).
[25]
Steffen Rendle, Christoph Freudenthaler, Zeno Gantner, and Lars Schmidt-Thieme . 2009. BPR: Bayesian Personalized Ranking from Implicit Feedback UAI.
[26]
Steffen Rendle, Christoph Freudenthaler, and Lars Schmidt-Thieme . 2010. Factorizing personalized Markov chains for next-basket recommendation WWW.
[27]
Badrul Sarwar, George Karypis, Joseph Konstan, and John Riedl . 2001. Item-based Collaborative Filtering Recommendation Algorithms WWW.
[28]
Markus Schedl . 2016. The LFM-1b Dataset for Music Retrieval and Recommendation ICMR.
[29]
Fabian M. Suchanek, Gjergji Kasneci, and Gerhard Weikum . 2007. Yago: A Core of Semantic Knowledge. In WWW. 697--706.
[30]
Nava Tintarev and Judith Masthoff . 2007. A Survey of Explanations in Recommender Systems. In ICDE. 801--810.
[31]
Katrien Verbert, Nikos Manouselis, Xavier Ochoa, Martin Wolpers, Hendrik Drachsler, Ivana Bosnic, and Erik Duval . 2012. Context-Aware Recommender Systems for Learning: A Survey and Future Challenges. TLT (2012), 318--335.
[32]
Pengfei Wang, Jiafeng Guo, Yanyan Lan, Jun Xu, Shengxian Wan, and Xueqi Cheng . 2015. Learning Hierarchical Representation Model for NextBasket Recommendation SIGIR. 403--412.
[33]
Quan Wang, Zhendong Mao, Bin Wang, and Li Guo . 2017. Knowledge Graph Embedding: A Survey of Approaches and Applications. IEEE TKDE (2017).
[34]
Jason Weston, Sumit Chopra, and Antoine Bordes . 2014. Memory Networks. Eprint Arxiv (2014).
[35]
Chao Yuan Wu, Amr Ahmed, Alex Beutel, How Jing, and How Jing . 2017. Recurrent Recommender Networks. In WSDM. 495--503.
[36]
Feng Yu, Qiang Liu, Shu Wu, Liang Wang, and Tieniu Tan . 2016. A Dynamic Recurrent Model for Next Basket Recommendation SIGIR. 729--732.
[37]
Xiao Yu, Xiang Ren, Yizhou Sun, Quanquan Gu, Bradley Sturt, Urvashi Khandelwal, Brandon Norick, and Jiawei Han . 2014. Personalized entity recommendation: a heterogeneous information network approach WSDM. 283--292.
[38]
Quan Yuan, Gao Cong, Zongyang Ma, Aixin Sun, and Nadia Magnenat-Thalmann . 2013. Time-aware point-of-interest recommendation. In SIGIR. 363--372.
[39]
Fuzheng Zhang, Nicholas Jing Yuan, Defu Lian, Xing Xie, and Wei Ying Ma . 2016. Collaborative Knowledge Base Embedding for Recommender Systems KDD.
[40]
Wayne Xin Zhao, Yanwei Guo, Yulan He, Han Jiang, Yuexin Wu, and Xiaoming Li . 2014. We know what you want to buy: a demographic-based system for product recommendation on microblogs. In KDD.
[41]
Wayne Xin Zhao, Sui Li, Yulan He, Edward Y. Chang, Ji-Rong Wen, and Xiaoming Li . 2016. Connecting Social Media to E-Commerce: Cold-Start Product Recommendation using Microblogging Information. TKDE (2016).

Cited By

View all

Index Terms

  1. Improving Sequential Recommendation with Knowledge-Enhanced Memory Networks

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    SIGIR '18: The 41st International ACM SIGIR Conference on Research & Development in Information Retrieval
    June 2018
    1509 pages
    ISBN:9781450356572
    DOI:10.1145/3209978
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 27 June 2018

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. knowledge base
    2. memory network
    3. sequential recommendation

    Qualifiers

    • Research-article

    Conference

    SIGIR '18
    Sponsor:

    Acceptance Rates

    SIGIR '18 Paper Acceptance Rate 86 of 409 submissions, 21%;
    Overall Acceptance Rate 792 of 3,983 submissions, 20%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)326
    • Downloads (Last 6 weeks)17
    Reflects downloads up to 15 Sep 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media