short-paper

Proactive Retrieval-based Chatbots based on Relevant Knowledge and Goals

Authors:

Zhicheng DouAuthors Info & Claims

SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

Pages 2000 - 2004

https://doi.org/10.1145/3404835.3463011

Published: 11 July 2021 Publication History

Abstract

A proactive dialogue system has the ability to proactively lead the conversation. Different from the general chatbots which only react to the user, proactive dialogue systems can be used to achieve some goals, e.g., to recommend some items to the user. Background knowledge is essential to enable smooth and natural transitions in dialogue. In this paper, we propose a new multi-task learning framework for retrieval-based knowledge-grounded proactive dialogue. To determine the relevant knowledge to be used, we frame knowledge prediction as a complementary task and use explicit signals to supervise its learning. The final response is selected according to the predicted knowledge, the goal to achieve, and the context. Experimental results show that explicit modeling of knowledge prediction and goal selection can greatly improve the final response selection. Our code is available at https://github.com/DaoD/KPN/.

References

[1]

Marjan Ghazvininejad, Chris Brockett, Ming-Wei Chang, Bill Dolan, Jianfeng Gao, Wen-tau Yih, and Michel Galley. 2018. A Knowledge-Grounded Neural Conversation Model. In Proceedings of the Thirty-Second AAAI Conference on Artificial Intelligence, (AAAI-18), the 30th innovative Applications of Artificial Intelligence (IAAI-18), and the 8th AAAI Symposium on Educational Advances in Artificial Intelligence (EAAI-18), New Orleans, Louisiana, USA, February 2--7, 2018, Sheila A. McIlraith and Kilian Q. Weinberger (Eds.). AAAI Press, 5110--5117.

[2]

Sepp Hochreiter and Jü rgen Schmidhuber. 1997. Long Short-Term Memory. Neural Comput., Vol. 9, 8 (1997), 1735--1780. https://doi.org/10.1162/neco.1997.9.8.1735

Digital Library

[3]

Kai Hua, Zhiyuan Feng, Chongyang Tao, Rui Yan, and Lu Zhang. 2020. Learning to Detect Relevant Contexts and Knowledge for Response Selection in Retrieval-based Dialogue Systems. In CIKM '20: The 29th ACM International Conference on Information and Knowledge Management, Virtual Event, Ireland, October 19--23, 2020, Mathieu d'Aquin, Stefan Dietze, Claudia Hauff, Edward Curry, and Philippe Cudré -Mauroux (Eds.). ACM, 525--534. https://doi.org/10.1145/3340531.3411967

Digital Library

[4]

Dongyeop Kang, Anusha Balakrishnan, Pararth Shah, Paul A. Crook, Y-Lan Boureau, and Jason Weston. 2019. Recommendation as a Communication Game: Self-Supervised Bot-Play for Goal-oriented Dialogue. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, China, November 3--7, 2019, Kentaro Inui, Jing Jiang, Vincent Ng, and Xiaojun Wan (Eds.). Association for Computational Linguistics, 1951--1961. https://doi.org/10.18653/v1/D19--1203

[5]

Raymond Li, Samira Ebrahimi Kahou, Hannes Schulz, Vincent Michalski, Laurent Charlin, and Chris Pal. 2018. Towards Deep Conversational Recommendations. In Advances in Neural Information Processing Systems 31: Annual Conference on Neural Information Processing Systems 2018, NeurIPS 2018, December 3--8, 2018, Montré al, Canada, Samy Bengio, Hanna M. Wallach, Hugo Larochelle, Kristen Grauman, Nicolò Cesa-Bianchi, and Roman Garnett (Eds.). 9748--9758.

[6]

Rongzhong Lian, Min Xie, Fan Wang, Jinhua Peng, and Hua Wu. 2019. Learning to Select Knowledge for Response Generation in Dialog Systems. In Proceedings of the Twenty-Eighth International Joint Conference on Artificial Intelligence, IJCAI 2019, Macao, China, August 10--16, 2019, Sarit Kraus (Ed.). ijcai.org, 5081--5087. https://doi.org/10.24963/ijcai.2019/706

[7]

Shuman Liu, Hongshen Chen, Zhaochun Ren, Yang Feng, Qun Liu, and Dawei Yin. 2018. Knowledge Diffusion for Neural Dialogue Generation. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, July 15--20, 2018, Volume 1: Long Papers, Iryna Gurevych and Yusuke Miyao (Eds.). Association for Computational Linguistics, 1489--1498. https://doi.org/10.18653/v1/P18--1138

[8]

Zeming Liu, Haifeng Wang, Zheng-Yu Niu, Hua Wu, Wanxiang Che, and Ting Liu. 2020. Towards Conversational Recommendation over Multi-Type Dialogs. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online, July 5--10, 2020, Dan Jurafsky, Joyce Chai, Natalie Schluter, and Joel R. Tetreault (Eds.). Association for Computational Linguistics, 1036--1049. https://doi.org/10.18653/v1/2020.acl-main.98

[9]

Jinghui Qin, Zheng Ye, Jianheng Tang, and Xiaodan Liang. 2020. Dynamic Knowledge Routing Network for Target-Guided Open-Domain Conversation. In The Thirty-Fourth AAAI Conference on Artificial Intelligence, AAAI 2020, The Thirty-Second Innovative Applications of Artificial Intelligence Conference, IAAI 2020, The Tenth AAAI Symposium on Educational Advances in Artificial Intelligence, EAAI 2020, New York, NY, USA, February 7--12, 2020. AAAI Press, 8657--8664.

[10]

Lianhui Qin, Michel Galley, Chris Brockett, Xiaodong Liu, Xiang Gao, Bill Dolan, Yejin Choi, and Jianfeng Gao. 2019. Conversing by Reading: Contentful Neural Conversation with On-demand Machine Reading. In Proceedings of the 57th Conference of the Association for Computational Linguistics, ACL 2019, Florence, Italy, July 28- August 2, 2019, Volume 1: Long Papers, Anna Korhonen, David R. Traum, and Llu'i s Mà rquez (Eds.). Association for Computational Linguistics, 5427--5436. https://doi.org/10.18653/v1/p19--1539

[11]

Jianheng Tang, Tiancheng Zhao, Chenyan Xiong, Xiaodan Liang, Eric P. Xing, and Zhiting Hu. 2019. Target-Guided Open-Domain Conversation. In Proceedings of the 57th Conference of the Association for Computational Linguistics, ACL 2019, Florence, Italy, July 28- August 2, 2019, Volume 1: Long Papers, Anna Korhonen, David R. Traum, and Llu'i s Mà rquez (Eds.). Association for Computational Linguistics, 5624--5634. https://doi.org/10.18653/v1/p19--1565

[12]

Wenquan Wu, Zhen Guo, Xiangyang Zhou, Hua Wu, Xiyuan Zhang, Rongzhong Lian, and Haifeng Wang. 2019. Proactive Human-Machine Conversation with Explicit Conversation Goal. In Proceedings of the 57th Conference of the Association for Computational Linguistics, ACL 2019, Florence, Italy, July 28- August 2, 2019, Volume 1: Long Papers, Anna Korhonen, David R. Traum, and Llu'i s Mà rquez (Eds.). Association for Computational Linguistics, 3794--3804. https://doi.org/10.18653/v1/p19--1369

[13]

Chunyuan Yuan, Wei Zhou, Mingming Li, Shangwen Lv, Fuqing Zhu, Jizhong Han, and Songlin Hu. 2019. Multi-hop Selector Network for Multi-turn Response Selection in Retrieval-based Chatbots. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing, EMNLP-IJCNLP 2019, Hong Kong, China, November 3--7, 2019, Kentaro Inui, Jing Jiang, Vincent Ng, and Xiaojun Wan (Eds.). Association for Computational Linguistics, 111--120. https://doi.org/10.18653/v1/D19--1011

[14]

Hao Yuan and Jinqi An. 2020. Multi-Hop Memory Network with Graph Neural Networks Encoding for Proactive Dialogue. In ICCAI '20: 2020 6th International Conference on Computing and Artificial Intelligence, Tianjin, China, April 23--26, 2020. ACM, 24--29. https://doi.org/10.1145/3404555.3404605

Digital Library

[15]

Saizheng Zhang, Emily Dinan, Jack Urbanek, Arthur Szlam, Douwe Kiela, and Jason Weston. 2018. Personalizing Dialogue Agents: I have a dog, do you have pets too?. In Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics, ACL 2018, Melbourne, Australia, July 15--20, 2018, Volume 1: Long Papers, Iryna Gurevych and Yusuke Miyao (Eds.). Association for Computational Linguistics, 2204--2213. https://doi.org/10.18653/v1/P18--1205

[16]

Yutao Zhu, Jian-Yun Nie, Kun Zhou, Pan Du, and Zhicheng Dou. 2021. Content Selection Network for Document-Grounded Retrieval-Based Chatbots. In Advances in Information Retrieval - 43rd European Conference on IR Research, ECIR 2021, Virtual Event, March 28 - April 1, 2021, Proceedings, Part I (Lecture Notes in Computer Science, Vol. 12656), Djoerd Hiemstra, Marie-Francine Moens, Josiane Mothe, Raffaele Perego, Martin Potthast, and Fabrizio Sebastiani (Eds.). Springer, 755--769. https://doi.org/10.1007/978--3-030--72113--8_50

[17]

Yutao Zhu, Ruihua Song, Zhicheng Dou, Jian-Yun Nie, and Jin Zhou. 2020. ScriptWriter: Narrative-Guided Script Generation. In Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics, ACL 2020, Online, July 5--10, 2020, Dan Jurafsky, Joyce Chai, Natalie Schluter, and Joel R. Tetreault (Eds.). Association for Computational Linguistics, 8647--8657. https://doi.org/10.18653/v1/2020.acl-main.765

Cited By

Zou JSun ALong CKanoulas E(2024)Knowledge-Enhanced Conversational Recommendation via Transformer-Based Sequential ModelingACM Transactions on Information Systems10.1145/367737642:6(1-27)Online publication date: 18-Oct-2024
https://dl.acm.org/doi/10.1145/3677376
Wu FZhao GLi TShen JQian X(2024)Improving Conversational Recommendation System Through Personalized Preference Modeling and Knowledge GraphIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.342158036:12(8529-8540)Online publication date: Dec-2024
https://doi.org/10.1109/TKDE.2024.3421580
Bouafoud CZine-Dine KMadani A(2024)The Evolution of Transformers in Education: A Literature Review2024 International Conference on Circuit, Systems and Communication (ICCSC)10.1109/ICCSC62074.2024.10617128(1-7)Online publication date: 28-Jun-2024
https://doi.org/10.1109/ICCSC62074.2024.10617128
Show More Cited By

Index Terms

Proactive Retrieval-based Chatbots based on Relevant Knowledge and Goals
1. Computing methodologies
  1. Artificial intelligence
    1. Natural language processing
      1. Discourse, dialogue and pragmatics

Recommendations

Dialogue History Matters! Personalized Response Selection in Multi-Turn Retrieval-Based Chatbots
Existing multi-turn context-response matching methods mainly concentrate on obtaining multi-level and multi-dimension representations and better interactions between context utterances and response. However, in real-place conversation scenarios, whether a ...
Proactive Knowledge-Goals Dialogue System Based on Pointer Network
Natural Language Processing and Chinese Computing
Abstract
Human-machine dialogue is the hot spot of current research. In this paper, we proposed an end-to-end dialogue system based on external knowledge, which realized active guidance and topic transfer in multiple rounds of dialogue. Our system is built ...
Speaker-Aware BERT for Multi-Turn Response Selection in Retrieval-Based Chatbots
CIKM '20: Proceedings of the 29th ACM International Conference on Information & Knowledge Management

In this paper, we study the problem of employing pre-trained language models for multi-turn response selection in retrieval-based chatbots. A new model, named Speaker-Aware BERT (SA-BERT), is proposed in order to make the model aware of the speaker ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGIR '21: Proceedings of the 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

July 2021

2998 pages

ISBN:9781450380379

DOI:10.1145/3404835

General Chairs:
Fernando Diaz
(Google)
,
Chirag Shah
University of Washington
,
Torsten Suel
New York University
,
Program Chairs:
Pablo Castells
Universidad Autónoma de Madrid, Amazon
,
Rosie Jones
Spotify
,
Tetsuya Sakai
Waseda University

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGIR: ACM Special Interest Group on Information Retrieval

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 11 July 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

Natural Science and Engineering Research Council of Canada
National Natural Science Foundation of China
Shandong Provincial Natural Science Foundation
Beijing Outstanding Young Scientist Program

Conference

SIGIR '21

Sponsor:

SIGIR

SIGIR '21: The 44th International ACM SIGIR Conference on Research and Development in Information Retrieval

July 11 - 15, 2021

Virtual Event, Canada

Acceptance Rates

Overall Acceptance Rate 792 of 3,983 submissions, 20%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
341
Total Downloads

Downloads (Last 12 months)44
Downloads (Last 6 weeks)9

Reflects downloads up to 29 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Zou JSun ALong CKanoulas E(2024)Knowledge-Enhanced Conversational Recommendation via Transformer-Based Sequential ModelingACM Transactions on Information Systems10.1145/367737642:6(1-27)Online publication date: 18-Oct-2024
https://dl.acm.org/doi/10.1145/3677376
Wu FZhao GLi TShen JQian X(2024)Improving Conversational Recommendation System Through Personalized Preference Modeling and Knowledge GraphIEEE Transactions on Knowledge and Data Engineering10.1109/TKDE.2024.342158036:12(8529-8540)Online publication date: Dec-2024
https://doi.org/10.1109/TKDE.2024.3421580
Bouafoud CZine-Dine KMadani A(2024)The Evolution of Transformers in Education: A Literature Review2024 International Conference on Circuit, Systems and Communication (ICCSC)10.1109/ICCSC62074.2024.10617128(1-7)Online publication date: 28-Jun-2024
https://doi.org/10.1109/ICCSC62074.2024.10617128
Posokhov PSkrylnikov SMakhnytkina OMatveev Y(2024)Hybrid Approach to the Personification of Dialogue AgentsArtificial Intelligence and Speech Technology10.1007/978-3-031-75164-6_8(102-115)Online publication date: 24-Nov-2024
https://doi.org/10.1007/978-3-031-75164-6_8
Kraus MWagner NRiekenbrauck RMinker W(2023)Improving Proactive Dialog Agents Using Socially-Aware Reinforcement LearningProceedings of the 31st ACM Conference on User Modeling, Adaptation and Personalization10.1145/3565472.3595611(146-155)Online publication date: 18-Jun-2023
https://dl.acm.org/doi/10.1145/3565472.3595611
Qin XDou ZZhu YWen J(2023)GDESA: Greedy Diversity Encoder with Self-attention for Search Results DiversificationACM Transactions on Information Systems10.1145/354410341:2(1-36)Online publication date: 3-Apr-2023
https://dl.acm.org/doi/10.1145/3544103
Liao LYang GShah CChen HDuh WHuang HKato MMothe JPoblete B(2023)Proactive Conversational Agents in the Post-ChatGPT WorldProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3594250(3452-3455)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3539618.3594250
Yu JLu MZhong QYao ZTu SLiao ZLi XLi MHou LZheng HLi JTang JChen HDuh WHuang HKato MMothe JPoblete B(2023)MoocRadar: A Fine-grained and Multi-aspect Knowledge Repository for Improving Cognitive Student Modeling in MOOCsProceedings of the 46th International ACM SIGIR Conference on Research and Development in Information Retrieval10.1145/3539618.3591898(2924-2934)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3539618.3591898
Liao LYang GShah CChua TLauw HSi LTerzi ETsaparas P(2023)Proactive Conversational AgentsProceedings of the Sixteenth ACM International Conference on Web Search and Data Mining10.1145/3539597.3572724(1244-1247)Online publication date: 27-Feb-2023
https://dl.acm.org/doi/10.1145/3539597.3572724
Zhu YSong RNie JDu PDou ZZhou J(2022)Leveraging Narrative to Generate Movie ScriptACM Transactions on Information Systems10.1145/350735640:4(1-32)Online publication date: 9-Mar-2022
https://dl.acm.org/doi/10.1145/3507356
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten