Article

Compositional program synthesis from natural language and examples

Authors:

Natasa Milic-FraylingAuthors Info & Claims

IJCAI'15: Proceedings of the 24th International Conference on Artificial Intelligence

Pages 792 - 800

Published: 25 July 2015 Publication History

Abstract

Compositionality is a fundamental notion in computation whereby complex abstractions can be constructed from simpler ones, yet this property has so far escaped the paradigm of end-user programming from examples or natural language. Existing approaches restrict end users to only give holistic specifications of tasks, which limits the expressivity and scalability of these approaches to relatively simple programs in very restricted domains. In this paper we propose Compositional Program Synthesis (CPS): an approach in which tasks can be specified in a compositional manner through a combination of natural language and examples. We present a domain-agnostic program synthesis algorithm and demonstrate its application to an expressive string manipulation language. We evaluate our approach on complex tasks from online help forums that are beyond the scope of current state-ofthe-art methods.

References

[1]

James F. Allen, Nathanael Chambers, George Ferguson, Lucian Galescu, Hyuckchul Jung, Mary D. Swift, and William Taysom. Plow: A collaborative task learning agent. In AAAI, pages 1514-1519. AAAI Press, 2007.

Digital Library

[2]

David L. Chen and Raymond J. Mooney. Learning to interpret natural language navigation instructions from observations. In Wolfram Burgard and Dan Roth, editors, AAAI. AAAI Press, 2011.

[3]

James Clarke, Dan Goldwasser, Ming-Wei Chang, and Dan Roth. Driving semantic parsing from the world's response. In Proceedings of the Fourteenth Conference on Computational Natural Language Learning (CoNLL-2010), pages 18-27, Uppsala, Sweden, 2010.

Digital Library

[4]

Sumit Gulwani and Mark Marron. Nlyze: Interactive programming by natural language for spreadsheet data analysis and manipulation. In Proceedings of the 2014 ACM SIGMOD International Conference on Management of Data, SIGMOD '14, pages 803-814, New York, NY, USA, 2014. ACM.

Digital Library

[5]

Sumit Gulwani, William R. Harris, and Rishabh Singh. Spreadsheet data manipulation using examples. Commun. ACM, 55(8), 2012.

Digital Library

[6]

Sumit Gulwani. Automating String Processing in Spreadsheets using Input-Output Examples. In Principles of Programming Languages (POPL), pages 317-330, 2011.

Digital Library

[7]

Susumu Katayama. Systematic search for lambda expressions. In Marko C. J. D. van Eekelen, editor, Revised Selected Papers from the Sixth Symposium on Trends in Functional Programming, TFP 2005, volume 6, pages 111-126. Intellect, 2007.

[8]

Dan Klein and Christopher D. Manning. Accurate unlexicalized parsing. In ACL '03: Proceedings of the 41st Annual Meeting on Association for Computational Linguistics, pages 423-430, Morristown, NJ, USA, 2003. Association for Computational Linguistics.

Digital Library

[9]

Nate Kushman and Regina Barzilay. Using semantic unification to generate regular expressions from natural language. In HLT-NAACL, pages 826-836. The Association for Computational Linguistics, 2013.

[10]

Tessa A. Lau, Pedro Domingos, and Daniel S. Weld. Learning programs from traces using version space algebra. In John H. Gennari, Bruce W. Porter, and Yolanda Gil, editors, K-CAP, pages 36-43. ACM, 2003.

Digital Library

[11]

Tessa A. Lau, Steven A. Wolfman, Pedro Domingos, and Daniel S. Weld. Programming by Demonstration Using Version Space Algebra. Machine Learning, 53(1-2):111-156, 2003.

Digital Library

[12]

Vu Le and Sumit Gulwani. Flashextract: A framework for data extraction by examples. In PLDI, 2014.

Digital Library

[13]

Percy Liang, Michael I. Jordan, and Dan Klein. Learning dependency-based compositional semantics. CoRR, abs/1109.6841, 2011.

[14]

Henry Lieberman, editor. Your Wish is My Command: Programming by Example. Morgan Kaufmann Publishers, 2001.

[15]

Mehdi Hafezi Manshadi, Daniel Gildea, and James F. Allen. Integrating programming by example and natural language programming. In Marie desJardins and Michael L. Littman, editors, AAAI. AAAI Press, 2013.

[16]

Daniel Perelman, Sumit Gulwani, Dan Grossman, and Peter Provost. Test-driven synthesis. In PLDI, 2014.

Digital Library

[17]

Chris Quirk, Pallavi Choudhury, Jianfeng Gao, Hisami Suzuki, Kristina Toutanova, Michael Gamon, Wen tau Yih, Colin Cherry, and Lucy Vanderwende. Msr splat, a language analysis toolkit. In HLTNAACL, pages 21-24. The Association for Computational Linguistics, 2012.

Digital Library

[18]

Mohammad Raza, Sumit Gulwani, and Natasa Milic-Frayling. Programming by example using least general generalizations. In AAAI, 2014.

[19]

Mohammad Raza, Sumit Gulwani, and Natasa Milic-Frayling. Compositional program synthesis from natural language and examples. Microsoft Research Technical Report MSR-TR-2015-33, 2015.

[20]

Luke S. Zettlemoyer and Michael Collins. Learning context-dependent mappings from sentences to logical form. In Keh-Yih Su, Jian Su, and Janyce Wiebe, editors, ACL/IJCNLP, pages 976-984. The Association for Computer Linguistics, 2009.

Digital Library

Cited By

Chen QBanerjee ADemiralp ÇDurrett GDillig I(2023)Data Extraction via Semantic Regular Expression SynthesisProceedings of the ACM on Programming Languages10.1145/36228637:OOPSLA2(1848-1877)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3622863
Kazemitabaar MChow JMa CEricson BWeintrop DGrossman T(2023)Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory ProgrammingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580919(1-23)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580919
Xu FVasilescu BNeubig G(2022)In-IDE Code Generation from Natural Language: Promise and ChallengesACM Transactions on Software Engineering and Methodology10.1145/348756931:2(1-47)Online publication date: 4-Mar-2022
https://dl.acm.org/doi/10.1145/3487569
Show More Cited By

Recommendations

Program synthesis using natural language
ICSE '16: Proceedings of the 38th International Conference on Software Engineering

Interacting with computers is a ubiquitous activity for millions of people. Repetitive or specialized tasks often require creation of small, often one-off, programs. End-users struggle with learning and using the myriad of domain-specific languages (...
Interactive synthesis of temporal specifications from examples and natural language

Motivated by applications in robotics, we consider the task of synthesizing linear temporal logic (LTL) specifications based on examples and natural language descriptions. While LTL is a flexible, expressive, and unambiguous language to describe robotic ...
iCoLa: A Compositional Meta-language with Support for Incremental Language Development
SLE 2022: Proceedings of the 15th ACM SIGPLAN International Conference on Software Language Engineering

Programming languages providing high-level abstractions can increase programmers’ productivity and program safety. Language-oriented programming is a paradigm in which domain-specific languages are developed to solve problems within specific domains ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

IJCAI'15: Proceedings of the 24th International Conference on Artificial Intelligence

July 2015

4429 pages

ISBN:9781577357384

Editors:
Qiang Yang
Hong Kong University of Science and Technology
,
Michael Wooldridge
University of Oxford

Sponsors

The International Joint Conferences on Artificial Intelligence, Inc. (IJCAI)

Publisher

AAAI Press

Publication History

Published: 25 July 2015

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

17
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

Chen QBanerjee ADemiralp ÇDurrett GDillig I(2023)Data Extraction via Semantic Regular Expression SynthesisProceedings of the ACM on Programming Languages10.1145/36228637:OOPSLA2(1848-1877)Online publication date: 16-Oct-2023
https://dl.acm.org/doi/10.1145/3622863
Kazemitabaar MChow JMa CEricson BWeintrop DGrossman T(2023)Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory ProgrammingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580919(1-23)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580919
Xu FVasilescu BNeubig G(2022)In-IDE Code Generation from Natural Language: Promise and ChallengesACM Transactions on Software Engineering and Methodology10.1145/348756931:2(1-47)Online publication date: 4-Mar-2022
https://dl.acm.org/doi/10.1145/3487569
Rahmani KRaza MGulwani SLe VMorris DRadhakrishna ASoares GTiwari A(2021)Multi-modal program inference: a marriage of pre-trained language models and component-based synthesisProceedings of the ACM on Programming Languages10.1145/34855355:OOPSLA(1-29)Online publication date: 15-Oct-2021
https://dl.acm.org/doi/10.1145/3485535
Bavishi RLemieux CSen KStoica I(2021)Gauss: program synthesis by reasoning over graphsProceedings of the ACM on Programming Languages10.1145/34855115:OOPSLA(1-29)Online publication date: 15-Oct-2021
https://dl.acm.org/doi/10.1145/3485511
Zhang GXu YShen XDillig I(2021)UDF to SQL translation through compositional lazy inductive synthesisProceedings of the ACM on Programming Languages10.1145/34854895:OOPSLA(1-26)Online publication date: 15-Oct-2021
https://dl.acm.org/doi/10.1145/3485489
Chen QLamoreaux AWang XDurrett GBastani ODillig IFreund SYahav E(2021)Web question answering with neurosymbolic program synthesisProceedings of the 42nd ACM SIGPLAN International Conference on Programming Language Design and Implementation10.1145/3453483.3454047(328-343)Online publication date: 19-Jun-2021
https://dl.acm.org/doi/10.1145/3453483.3454047
Li YLi SXu ZCao JChen ZHu YChen HCheung S(2021)TransRegexProceedings of the 43rd International Conference on Software Engineering10.1109/ICSE43902.2021.00111(1210-1222)Online publication date: 22-May-2021
https://dl.acm.org/doi/10.1109/ICSE43902.2021.00111
Chen YMartins RFeng YDumas MPfahl DApel SRusso A(2019)Maximal multi-layer specification synthesisProceedings of the 2019 27th ACM Joint Meeting on European Software Engineering Conference and Symposium on the Foundations of Software Engineering10.1145/3338906.3338951(602-612)Online publication date: 12-Aug-2019
https://dl.acm.org/doi/10.1145/3338906.3338951
So SOh H(2018)Synthesizing pattern programs from examplesProceedings of the 27th International Joint Conference on Artificial Intelligence10.5555/3304415.3304645(1618-1624)Online publication date: 13-Jul-2018
https://dl.acm.org/doi/10.5555/3304415.3304645
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents