Article

Spoken Programs

Authors:

Andrew Begel,

Susan L. GrahamAuthors Info & Claims

VLHCC '05: Proceedings of the 2005 IEEE Symposium on Visual Languages and Human-Centric Computing

Pages 99 - 106

https://doi.org/10.1109/VLHCC.2005.58

Published: 20 September 2005 Publication History

Publisher Site

Abstract

Programmers who suffer from repetitive stress injuries find it difficult to spend long amounts of time typing code. Speech interfaces can help developers reduce their dependence on typing. However, existing programming by voice techniques make it awkward for programmers to enter and edit program text. To design a better alternative, we conducted a study to learn how software developers naturally verbalize programs. We found that spoken programs are different from written programs in ways similar to the differences between spoken and written English; spoken programs contain lexical, syntactic and semantic ambiguities that do not appear in written programs. Using the results from this study, we designed Spoken Java, a semantically identical variant of Java that is easier to say out loud. Using Spoken Java, software developers can speak more naturally by verbalizing their program code as if they were reading it out loud. Spoken Java is analyzed by extending a conventional Java programming language analysis engine written in our Harmonia program analysis framework to support the kinds of ambiguities that arise from speech.

Cited By

View all

Santos ACancelinha ABatista FDig DBryksin TGolubev YBezzubov A(2024)Jasay: Towards Voice Commands in Projectional EditorsProceedings of the 1st ACM/IEEE Workshop on Integrated Development Environments10.1145/3643796.3648449(30-34)Online publication date: 20-Apr-2024
https://dl.acm.org/doi/10.1145/3643796.3648449
Nowrin SVertanen K(2023)Programming by Voice: Exploring User Preferences and Speaking StylesProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3597130(1-13)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3597130
Kazemitabaar MChow JMa CEricson BWeintrop DGrossman T(2023)Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory ProgrammingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580919(1-23)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580919
Show More Cited By

Index Terms

Spoken Programs
1. Hardware
  1. Communication hardware, interfaces and storage
    1. Sound-based input / output
2. Human-centered computing
  1. Human computer interaction (HCI)
    1. Interaction devices
      1. Sound-based input / output
  2. Interaction design
    1. Interaction design process and methods
      1. User centered design

Recommendations

Human-robot collaborative tutoring using multiparty multimodal spoken dialogue
HRI '14: Proceedings of the 2014 ACM/IEEE international conference on Human-robot interaction

In this paper, we describe a project that explores a novel experimental setup towards building a spoken, multi-modally rich, and human-like multiparty tutoring robot. A human-robot interaction setup is designed, and a human-human dialogue corpus is ...
Conversation Acts in Task-Oriented Spoken Dialogue
Evaluation of spoken multimodal conversation
ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces

Spoken multimodal dialogue systems in which users address face-only or embodied interface agents have been gaining ground in research for some time. Although most systems are still strictly task-oriented, the field is now moving towards domain-oriented ...

Comments

Information & Contributors

Information

Published In

VLHCC '05: Proceedings of the 2005 IEEE Symposium on Visual Languages and Human-Centric Computing

September 2005

304 pages

ISBN:0769524435

Publisher

IEEE Computer Society

United States

Publication History

Published: 20 September 2005

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

15
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 06 Jan 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Santos ACancelinha ABatista FDig DBryksin TGolubev YBezzubov A(2024)Jasay: Towards Voice Commands in Projectional EditorsProceedings of the 1st ACM/IEEE Workshop on Integrated Development Environments10.1145/3643796.3648449(30-34)Online publication date: 20-Apr-2024
https://dl.acm.org/doi/10.1145/3643796.3648449
Nowrin SVertanen K(2023)Programming by Voice: Exploring User Preferences and Speaking StylesProceedings of the 5th International Conference on Conversational User Interfaces10.1145/3571884.3597130(1-13)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3571884.3597130
Kazemitabaar MChow JMa CEricson BWeintrop DGrossman T(2023)Studying the effect of AI Code Generators on Supporting Novice Learners in Introductory ProgrammingProceedings of the 2023 CHI Conference on Human Factors in Computing Systems10.1145/3544548.3580919(1-23)Online publication date: 19-Apr-2023
https://dl.acm.org/doi/10.1145/3544548.3580919
Paudyal BCreed CWilliams IFrutos-Pascual M(2022)Inclusive Multimodal Voice Interaction for Code NavigationProceedings of the 2022 International Conference on Multimodal Interaction10.1145/3536221.3556600(509-519)Online publication date: 7-Nov-2022
https://dl.acm.org/doi/10.1145/3536221.3556600
Nowrin S(2022)Programming by voiceACM SIGACCESS Accessibility and Computing10.1145/3523265.3523270(1-1)Online publication date: 1-Mar-2022
https://dl.acm.org/doi/10.1145/3523265.3523270
Nowrin SOrdóñEz PVertanen K(2022)Exploring Motor-impaired Programmers’ Use of Speech RecognitionProceedings of the 24th International ACM SIGACCESS Conference on Computers and Accessibility10.1145/3517428.3550392(1-4)Online publication date: 23-Oct-2022
https://dl.acm.org/doi/10.1145/3517428.3550392
Kluge ALitherland KBorgen PLanslet G(2019)Combining Programming with Audio ExplanationsProceedings of the 11th International Conference on Education Technology and Computers10.1145/3369255.3369283(155-159)Online publication date: 28-Oct-2019
https://dl.acm.org/doi/10.1145/3369255.3369283
Swidan AHermans FZhang MYang BCooper SLuxton-Reilly A(2019)The Effect of Reading Code Aloud on ComprehensionProceedings of the ACM Conference on Global Computing Education10.1145/3300115.3309504(178-184)Online publication date: 9-May-2019
https://dl.acm.org/doi/10.1145/3300115.3309504
Barmpoutis AJoy MIhantola P(2018)Learning Programming Languages as Shortcuts to Natural Language Token ReplacementsProceedings of the 18th Koli Calling International Conference on Computing Education Research10.1145/3279720.3279721(1-10)Online publication date: 22-Nov-2018
https://dl.acm.org/doi/10.1145/3279720.3279721
Hermans FSwidan AAivaloglou EKhomh FRoy CSiegmund J(2018)Code phonologyProceedings of the 26th Conference on Program Comprehension10.1145/3196321.3196355(308-311)Online publication date: 28-May-2018
https://dl.acm.org/doi/10.1145/3196321.3196355
Show More Cited By

Abstract

Cited By

Index Terms

Recommendations

Human-robot collaborative tutoring using multiparty multimodal spoken dialogue

Conversation Acts in Task-Oriented Spoken Dialogue

Evaluation of spoken multimodal conversation

Comments

Information

Published In

Publisher

Publication History

Qualifiers

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

View options

Figures

Other

Share

Share this Publication link

Share on social media

Affiliations