Article

When policies are better than plans: decision-theoretic planning of recommendation sequences

Authors:

Thorsten Bohnenberger,

Anthony JamesonAuthors Info & Claims

IUI '01: Proceedings of the 6th international conference on Intelligent user interfaces

Pages 21 - 24

https://doi.org/10.1145/359784.359829

Published: 01 January 2001 Publication History

Get Access

Abstract

An intelligent user interface sometimes needs to present a sequence of related recommendations to a user, in spite of being uncertain in advance as to whether (and with what success) the user will follow each recommendation. There are potential advantages to the use of decision-theoretic planning methods which yield an optimal policyfor the situation-dependent presentation of recommendations. This approach is discussed with reference to an example involving route instructions given by an airport assistance system.

References

[1]

J. Blythe. Decision-theoretic planning. AI Magazine, 20(2):37- 54, 1999.

Google Scholar

[2]

C. Boutilier, T. Dean, and S. Hanks. Decision-theoretic plan-ning: Structural assumptions and computational leverage. Jour-nal of Artificial Intelligence Research, 11:1-94, 1999.

Digital Library

Google Scholar

[3]

A. Jameson, B. Gro~mann-Hutter, L. March, R. Rummer, T. Bohnenberger, and F. Wittig. When actions have conse-quences: Empirically based decision making for intelligent user interfaces. Knowledge-Based Systems, 13, 2000. In press.

Google Scholar

[4]

T. Joachims, D. Freitag, and T. Mitchell. WebWatcher: A tour guide for the World Wide Web. In M. E. Pollack, editor, Pro-ceedings of the Fifteenth International Joint Conference on Ar-tificial Intelligence, pages 770-777. Morgan Kaufmann, San Francisco, CA, 1997.

Google Scholar

[5]

L. Pryor and G. Collins. Planning for contingencies: A decision-based approach. Journal of Artificial Intelligence Research, 4:287-339, 1996.

Digital Library

Google Scholar

[6]

S. Rogers, C. Fiechter, and P. Langley. An adaptive interactive agent for route advice. In Proceedings of the Third International Conference on Autonomous Agents, Seattle, WA, 1999.

Digital Library

Google Scholar

[7]

W. Wahlster, E. Andr~ e, W. Finkler, H.-J. Profitlich, and T. Rist. Plan-based integration of natural language and graphics genera-tion. Artificial Intelligence, 63:387-427, 1993.

Digital Library

Google Scholar

Cited By

View all

Zhou FLuo BWu ZHuang T(2024)SMONAC: Supervised Multiobjective Negative Actor–Critic for Sequential RecommendationIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.331735335:12(18525-18537)Online publication date: Dec-2024
https://doi.org/10.1109/TNNLS.2023.3317353
Iftikhar AGhazanfar MAyub MAli Alahmari SQazi NWall J(2024)A reinforcement learning recommender system using bi-clustering and Markov Decision ProcessExpert Systems with Applications10.1016/j.eswa.2023.121541237(121541)Online publication date: Mar-2024
https://doi.org/10.1016/j.eswa.2023.121541
Rezaei MTabrizi N(2023)A Survey on Reinforcement Learning and Deep Reinforcement Learning for Recommender SystemsDeep Learning Theory and Applications10.1007/978-3-031-39059-3_26(385-402)Online publication date: 31-Jul-2023
https://doi.org/10.1007/978-3-031-39059-3_26
Show More Cited By

Index Terms

When policies are better than plans: decision-theoretic planning of recommendation sequences

Recommendations

Internalized plans: A representation for action resources

In the ongoing pursuit to produce intelligent autonomous agents that can operate in real world environments, emerging concepts about the relationships between planning and action are inspiring new alternatives in plan representation. The simple yet ...
Contingent planning under uncertainty via stochastic satisfiability
special issue on planning with uncertainty and incomplete information

We describe a new planning technique that efficiently solves probabilistic propositional contingent planning problems by converting them into instances of stochastic satisfiability (SSAT) and solving these problems instead. We make fundamental ...
On computing conformant plans using classical planners: a generate-and-complete approach
ICAPS'12: Proceedings of the Twenty-Second International Conference on International Conference on Automated Planning and Scheduling

The paper illustrates a novel approach to conformant planning using classical planners. The approach relies on two core ideas developed to deal with incomplete information in the initial situation: the use of a classical planner to solve non-classical ...

Comments

Information & Contributors

Information

Published In

IUI '01: Proceedings of the 6th international conference on Intelligent user interfaces

January 2001

174 pages

ISBN:1581133251

DOI:10.1145/359784

Chairmen:
Candy Sidner
MERL
,
Johanna Moore
Univ. of Edinburgh, Edinburgh, Scotland

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 January 2001

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

IUI01

Sponsor:

IUI01: International Conference on Intelligent User Interfaces 2001

January 14 - 17, 2001

New Mexico, Santa Fe, USA

Acceptance Rates

Overall Acceptance Rate 726 of 2,754 submissions, 26%

Upcoming Conference

IUI '25

Sponsor:
sigai
sigai

30th International Conference on Intelligent User Interfaces

March 24 - 27, 2025

Cagliari , Italy

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
364
Total Downloads

Downloads (Last 12 months)2
Downloads (Last 6 weeks)1

Reflects downloads up to 12 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Zhou FLuo BWu ZHuang T(2024)SMONAC: Supervised Multiobjective Negative Actor–Critic for Sequential RecommendationIEEE Transactions on Neural Networks and Learning Systems10.1109/TNNLS.2023.331735335:12(18525-18537)Online publication date: Dec-2024
https://doi.org/10.1109/TNNLS.2023.3317353
Iftikhar AGhazanfar MAyub MAli Alahmari SQazi NWall J(2024)A reinforcement learning recommender system using bi-clustering and Markov Decision ProcessExpert Systems with Applications10.1016/j.eswa.2023.121541237(121541)Online publication date: Mar-2024
https://doi.org/10.1016/j.eswa.2023.121541
Rezaei MTabrizi N(2023)A Survey on Reinforcement Learning and Deep Reinforcement Learning for Recommender SystemsDeep Learning Theory and Applications10.1007/978-3-031-39059-3_26(385-402)Online publication date: 31-Jul-2023
https://doi.org/10.1007/978-3-031-39059-3_26
Lechiakh MMaurer A(2022)FEBR: Expert-Based Recommendation Framework for Beneficial and Personalized ContentNetworked Systems10.1007/978-3-031-17436-0_5(52-68)Online publication date: 28-Sep-2022
https://doi.org/10.1007/978-3-031-17436-0_5
Kumar GJerbi HO’Mahony M(2021)A sequence-based and context modelling framework for recommendationExpert Systems with Applications: An International Journal10.1016/j.eswa.2021.114665175:COnline publication date: 1-Aug-2021
https://dl.acm.org/doi/10.1016/j.eswa.2021.114665
Jean-Baptiste ERussell MHowe JRotshtein P(2017)Intelligent prompting system to assist stroke survivorsJournal of Ambient Intelligence and Smart Environments10.3233/AIS-1704619:6(707-723)Online publication date: 2-Nov-2017
https://doi.org/10.3233/AIS-170461
Jean-Baptiste ERussell MHowe JRotshtein P(2015)CogWatch: Intelligent agent-based system to assist stroke survivors during tea-making2015 SAI Intelligent Systems Conference (IntelliSys)10.1109/IntelliSys.2015.7361179(452-456)Online publication date: Nov-2015
https://doi.org/10.1109/IntelliSys.2015.7361179
Shi CIshida TLin D(2014)Translation Agent: A New Metaphor for Machine TranslationNew Generation Computing10.1007/s00354-014-0204-032:2(163-186)Online publication date: 3-May-2014
https://doi.org/10.1007/s00354-014-0204-0
Shi CLin DIshida TKim JNichols JSzekely P(2013)Agent metaphor for machine translation mediated communicationProceedings of the 2013 international conference on Intelligent user interfaces10.1145/2449396.2449407(67-74)Online publication date: 19-Mar-2013
https://dl.acm.org/doi/10.1145/2449396.2449407
Hui BGustafson SIrani PBoutilier CLevialdi S(2008)The need for an interaction cost model in adaptive interfacesProceedings of the working conference on Advanced visual interfaces10.1145/1385569.1385658(458-461)Online publication date: 28-May-2008
https://dl.acm.org/doi/10.1145/1385569.1385658
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Cited By

Index Terms

Recommendations

Internalized plans: A representation for action resources

Contingent planning under uncertainty via stochastic satisfiability

On computing conformant plans using classical planners: a generate-and-complete approach

Comments

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Other Metrics

Article Metrics

Other Metrics

Cited By

Login options

Full Access

PDF

eReader

Abstract

References

Cited By

Index Terms

Recommendations

Internalized plans: A representation for action resources

Contingent planning under uncertainty via stochastic satisfiability

On computing conformant plans using classical planners: a generate-and-complete approach

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Conference

Acceptance Rates

Upcoming Conference

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations