research-article

Free access

Markov logic networks for situated incremental natural language understanding

Authors:

Casey Kennington,

David SchlangenAuthors Info & Claims

SIGDIAL '12: Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue

Pages 314 - 323

Published: 05 July 2012 Publication History

Abstract

We present work on understanding natural language in a situated domain, that is, language that possibly refers to visually present entities, in an incremental, word-by-word fashion. Such type of understanding is required in conversational systems that need to act immediately on language input, such as multi-modal systems or dialogue systems for robots. We explore a set of models specified as Markov Logic Networks, and show that a model that has access to information about the visual context of an utterance, its discourse context, as well as the linguistic structure of the utterance performs best. We explore its incremental properties, and also its use in a joint parsing and understanding module. We conclude that mlns offer a promising framework for specifying such models in a general, possibly domain-independent way.

References

[1]

Gregory Aist, James Allen, Ellen Campana, Carlos Gomez Gallo, Scott Stoness, Mary Swift, and Michael K. Tanenhaus. 2007. Incremental understanding in human-computer dialogue and experimental evidence for advantages over nonincremental methods. In Proceedings of Decalog 2007, the 11th International Workshop on the Semantics and Pragmatics of Dialogue, Trento, Italy.

[2]

Okko Buß, Timo Baumann, and David Schlangen. 2010. Collaborating on utterances with a spoken dialogue system using an isu-based approach to incremental dialogue management. In Proceedings of the SIGdial 2010 Conference, pages 233--236, Tokyo, Japan, September.

Digital Library

[3]

Fei Chen. 2009. Coreference Resolution with Markov Logic. Association for the Advancement of Artificial Intelligence.

[4]

Ann Copestake. 2007. Semantic composition with (robust) minimal recursion semantics. In Proceedings of the Workshop on Deep Linguistic Processing - DeepLP '07, page 73, Morristown, NJ, USA. Association for Computational Linguistics.

Digital Library

[5]

D. DeVault, Kenji Sagae, and David Traum. 2009. Can I finish?: learning when to respond to incremental interpretation results in interactive dialogue. In Proceedings of the SIGDIAL 2009 Conference: The 10th Annual Meeting of the Special Interest Group on Discourse and Dialogue, number September, pages 11--20. Association for Computational Linguistics.

Digital Library

[6]

David Devault, Kenji Sagae, and David Traum. 2011. Incremental Interpretation and Prediction of Utterance Meaning for Interactive Dialogue. Dialoge & Discourse, 2(1): 143--170.

[7]

Pedro Domingos, Stanley Kok, Hoifung Poon, and Matthew Richardson. 2006. Unifying logical and statistical AI. American Association of Artificial Intelligence.

Digital Library

[8]

Raquel Fernández, Tatjana Lucht, and David Schlangen. 2007. Referring under restricted interactivity conditions. In Proceedings of the 8th SIGdial Workshop on Discourse and Dialogue, pages 136--139.

[9]

Silvan Heintze, Timo Baumann, and David Schlangen. 2010. Comparing local and sequential models for statistical incremental natural language understanding. In Proceedings of the 11th Annual Meeting of the Special Interest Group on Discourse and Dialogue, pages 9--16. Association for Computational Linguistics.

Digital Library

[10]

Ross Kindermann and J. Laurie Snell. 1980. Markov random fields and their applications. In In Practice, volume 1 of Contemporary Mathematics, page 142. American Mathematical Society.

[11]

Percy Liang, Michael Jordan, and Dan Klein. 2011. Learning Dependency-Based Compositional Semantics. In Proceedings of the 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies, pages 590--599, Portland, Oregon. Association for Computational Linguistics.

Digital Library

[12]

Marie-jean Meurs, Frederic Duvert, Fabrice Lefevre, and Renato De Mori. 2008. Markov Logic Networks for Spoken Language Interpretation. Information Systems Journal, (1978): 535--544.

[13]

Ivan Meza-Ruiz and Sebastian Riedel. 2009. Jointly identifying predicates, arguments and senses using Markov logic. In Proceedings of Human Language Technologies: The 2009 Annual Conference of the North American Chapter of the Association for Computational Linguistics on - NAACL '09, number June, page 155, Morristown, NJ, USA. Association for Computational Linguistics.

Digital Library

[14]

Andreas Peldszus, Okko Buß, Timo Baumann, and David Schlangen. 2012. Joint Satisfaction of Syntactic and Pragmatic Constraints Improves Incremental Spoken Language Understanding. In Proceedings of the 13th Conference of the European Chapter of the Association for Computational Linguistics, pages 514--523, Avignon, France, April. Association for Computational Linguistics.

Digital Library

[15]

Matthew Richardson and Pedro Domingos. 2006. Markov logic networks. Machine Learning, 62(1--2): 107--136.

Digital Library

[16]

Deb Roy. 2005. Grounding words in perception and action: computational insights. Trends in Cognitive Sciences, 9(8): 389--396, August.

[17]

Sandeepkumar Satpal, Sahely Bhadra, S Sundararajan Rajeev, and Rastogi Prithviraj. 2011. Web Information Extraction Using Markov Logic Networks. Learning, pages 1406--1414.

Digital Library

[18]

David Schlangen and Gabriel Skantze. 2009. A General, Abstract Model of Incremental Dialogue Processing. In Proceedings of the 12th Conference of the European Chapter of the ACL (EACL 2009), number April, pages 710--718, Athens, Greece. Association for Computational Linguistics.

Digital Library

[19]

David Schlangen, Timo Baumann, and Michaela Atterer. 2009. Incremental Reference Resolution: The Task, Metrics for Evaluation, and a {B}ayesian Filtering Model that is Sensitive to Disfluencies. In Proceedings of the SIGDIAL 2009 Conference, number September, pages 30--37, London, UK. Association for Computational Linguistics.

Digital Library

[20]

Alexander Siebert and David Schlangen. 2008. A Simple Method for Resolution of Definite Reference in a Shared Visual Context. In Proceedings of the 9th SIGdial Workshop on Discourse and Dialogue, number June, pages 84--87, Columbus, Ohio. Association for Computational Linguistics.

Digital Library

[21]

Parag Singla and Pedro Domingos. 2005. Discriminative Training of Markov Logic Networks. Computing, 20(2): 868--873.

[22]

Michael Spranger, Martin Loetzsch, and Simon Pauw. 2010. Open-ended Grounded Semantics. In European Conference on Artificial Intelligence 2010, Lisbon, Portugal. Volume 215 Frontiers in Artificial Intelligence and Applications.

Digital Library

[23]

Luke S. Zettlemoyer and Michael Collins. 2009. Learning context-dependent mappings from sentences to logical form. Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2 - ACL-IJCNLP '09, 2: 976.

Digital Library

Cited By

Kennington CSchlangen D(2017)A simple generative model of incremental reference resolution for situated dialogueComputer Speech and Language10.1016/j.csl.2016.04.00241:C(43-67)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1016/j.csl.2016.04.002
Yeh J(2016)Speech Act Identification Using Semantic Dependency Graphs with Probabilistic Context-Free GrammarsACM Transactions on Asian and Low-Resource Language Information Processing10.1145/278697815:1(1-28)Online publication date: 7-Jan-2016
https://dl.acm.org/doi/10.1145/2786978

Markov logic networks for situated incremental natural language understanding
1. Computing methodologies
  1. Artificial intelligence
2. Hardware
  1. Power and energy
    1. Power estimation and optimization

Recommendations

Situated incremental natural language understanding using Markov Logic Networks

We present work on understanding natural language in a situated domain in an incremental, word-by-word fashion. We explore a set of models specified as Markov Logic Networks and show that a model that has access to information about the visual context ...
Natural Communication about Uncertainties in Situated Interaction
ICMI '14: Proceedings of the 16th International Conference on Multimodal Interaction

Physically situated, multimodal interactive systems must often grapple with uncertainties about properties of the world, people, and their intentions and actions. We present methods for estimating and communicating about different uncertainties in ...
Natural Language, Mixed-initiative Personal Assistant Agents
IMCOM '18: Proceedings of the 12th International Conference on Ubiquitous Information Management and Communication

The increasing popularity and use of personal voice assistant technologies, such as Siri and Google Now, is driving and expanding progress toward the long-term and lofty goal of using artificial intelligence to build human-computer dialog systems ...

Comments

Information & Contributors

Information

Published In

cover image DL Hosted proceedings

SIGDIAL '12: Proceedings of the 13th Annual Meeting of the Special Interest Group on Discourse and Dialogue

July 2012

341 pages

General Chairs:
Gary Geunbae Lee
POSTECH, South Korea
,
Jonathan Ginzburg
Universite Paris-Diderot, France

Publisher

Association for Computational Linguistics

United States

Publication History

Published: 05 July 2012

Qualifiers

Research-article

Acceptance Rates

Overall Acceptance Rate 19 of 46 submissions, 41%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

2
Total Citations
View Citations
94
Total Downloads

Downloads (Last 12 months)8
Downloads (Last 6 weeks)1

Reflects downloads up to 27 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Kennington CSchlangen D(2017)A simple generative model of incremental reference resolution for situated dialogueComputer Speech and Language10.1016/j.csl.2016.04.00241:C(43-67)Online publication date: 1-Jan-2017
https://dl.acm.org/doi/10.1016/j.csl.2016.04.002
Yeh J(2016)Speech Act Identification Using Semantic Dependency Graphs with Probabilistic Context-Free GrammarsACM Transactions on Asian and Low-Resource Language Information Processing10.1145/278697815:1(1-28)Online publication date: 7-Jan-2016
https://dl.acm.org/doi/10.1145/2786978

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents