skip to main content
10.1145/1027933.1027936acmconferencesArticle/Chapter ViewAbstractPublication Pagesicmi-mlmiConference Proceedingsconference-collections
Article

Another person's eye gaze as a cue in solving programming problems

Published: 13 October 2004 Publication History

Abstract

Expertise in computer programming can often be difficult to transfer verbally. Moreover, technical training and communication occur more and more between people who are located at a distance. We tested the hypothesis that seeing one person's visual focus of attention (represented as an eyegaze cursor) while debugging software (displayed as text on a screen) can be helpful to another person doing the same task. In an experiment, a group of professional programmers searched for bugs in small Java programs while wearing an unobtrusive head-mounted eye tracker. Later, a second set of programmers searched for bugs in the same programs. For half of the bugs, the second set of programmers first viewed a recording of an eyegaze cursor from one of the first programmers displayed over the (indistinct) screen of code, and for the other half they did not. The second set of programmers found the bugs more quickly after viewing the eye gaze of the first programmers, suggesting that another person's eye gaze, produced instrumentally (as opposed to intentionally, like pointing with a mouse), can be a useful cue in problem solving. This finding supports the potential of eye gaze as a valuable cue for collaborative interaction in a visuo-spatial task conducted at a distance.

References

[1]
Ballard, D. H., Hayhoe, M. M., Li, F., and Whitehead, S. D. (1992). Hand-eye coordination during sequential tasks. Philosophical Transactions of the Royal Society of London, B(337), 331--339.
[2]
Ballard, D. H., Hayhoe, M. M., and Pelz, J. B. (1995). Memory representations in natural tasks. Journal of Cognitive Neuroscience, 7(1), 66--80.
[3]
Brennan, S. E. (1990). Seeking and providing evidence for mutual understanding. Unpublished doctoral dissertation, Stanford University.
[4]
Brennan, S. E. (In press). How conversation is shaped by visual and spoken evidence. In J. Trueswell and M. Tanenhaus (Eds.), World Situated Language Use: Psycholinguistic, Linguistic and Computational Perspectives on Bridging the Product and Action Traditions. Cambridge, MA: MIT Press.
[5]
Brennan, S. E. (1995). Centering attention in discourse. Language and Cognitive Processes, 10, 137--167.
[6]
Brennan, S. E. and Lockridge, C. B. Monitoring an addressee's visual attention: Effects of visual co-presence on referring in conversation. Unpublished manuscript.
[7]
Clark, H.H. and Brennan, S.E. (1991). Grounding in communication. In L.B. Resnick, J.M. Levine and S.D. Teasley (Eds.) Perspectives on socially shared cognition (pp. 127--149). Washington, DC: American Psychological Association.
[8]
Doherty-Sneddon, G., Anderson, A., O'Malley, C., Langton, S., Garrod, S., and Bruce, V. (1997). Face-to-face and video-mediated communication: A comparison of dialogue structure and task performance. Journal of Experimental Psychology: Applied, 3, 105-125.
[9]
Dourish, P., Adler, A., Bellotti, V., and Henderson, A. (1996). Your place or mine? Learning from long-term use of audio-video communication. Computer Supported Cooperative Work, 5, 33--62.
[10]
Fix, V., Wiedenbeck, S., and Scholtz, J. Mental representations of programs by novices and experts. Proceedings of the SIGCHI conference on human factors in computing systems (CHI 93)
[11]
Grice, H. P. (1975). Logic and conversation (from the William James lectures, Harvard University, 1967). In P. Cole and J. Morgan (Eds.), Syntax and semantics 3: Speech acts. (pp. 41--58). New York: Academic Press.
[12]
Grosz, B. J., Joshi, A. K., and Weinstein, S. (1995). Centering: A framework for modelling the local coherence of discourse. Computational Linguistics.
[13]
Grosz, B. J. and Sidner, C. L. (1986). Attention, intentions, and the structure of discourse. Computational Linguistics, 12, 175-204.
[14]
Gugerty, L and Olson, G.M. (1986) "Debugging by Skilled and Novice Programmers." CHI '86 Proceedings,171-174.
[15]
Gutwin, C., Greenberg, S., and Roseman, M. (1996). Supporting awareness of others in groupware. ACM CHI '96 Conference Companion.
[16]
Hanna, J. E, and Brennan, S. E. (2003). Eye gaze has immediate effects on reference resolution in conversation. Abstracts of the Psychonomic Society, 44th Annual Meeting (p. 124), Vancouver, Canada.
[17]
Hanna, J.E. and Brennan, S. E. (2004). Using a Speaker's Eye gaze During Comprehension: A Cue Both Rapid and Flexible. Abstract, 17th Annual CUNY Conference on Human Sentence Processing, College Park, MD.
[18]
Hindmarsh, Fraser, Heath, Benford, and Greenhalgh, 1998.Hindmarsh, J. Fraser, M., Heath, C., Benford, S., and Greenhalgh, C. (1998). Fragmented interaction: establishing mutual orientation in virtual environments. Proceedings ACM Conference on Computer supported Cooperative Work (pp. 217-226), November 14 - 18, 1998, Seattle, WA.
[19]
Isaacs, E. A., Tang, J. C., and Morris, T. (1996). Piazza: A desktop environment supporting impromptu and planned interactions. CSCW '96, 315--324.
[20]
Ishii, H., Kobayshi, M., and Grudin, J. (1992). Integration of inter-personal space and shared workspace: ClearBoard design and experiments. In Proceedings, ACM Conference on Computer-Supported Cooperative Work, CSCW '92 (pp. 33--42). New York: ACM Press.
[21]
Jacob, R. J. K. (1995). Eye tracking in advanced interface design. In W. Barfield and T. A. Furness (Eds.), Virtual environments and advanced interface design (pp. 258-308). New York: OxfordUniversity Press.
[22]
Karsenty, L. (1999). Cooperative work and shared visual context: An empirical study of comprehension problems in side-by-side and remote help dialogues. Human-Computer Interaction, 14, 283-316.
[23]
Koenemann, J., and Robertson, S. P. (1991) "Expert Problem Solving Strategies for Program Comprehension." Human Factors in Computing Systems: CHI '91, 125-130.
[24]
Kraut, R. E., Fussell, S. R., Brennan, S. E., and Siegel, J. (2002). Understanding effects of proximity on collaboration : Implications for technologies to support remote collaborative work. In P. Hinds and S. Kiesler, Distributed work (pp. 137--162). Cambridge, MA: MIT Press.
[25]
Nardi, B., Schwartz, H. Kuchinsky, A., Leichner, R., Whittaker, S., and Sclabassi, R. (1993). Turning away from talking heads: An analysis of video-as-data. Proceedings, CHI '99, Human Factors in Computing Systems, pp. 327--334. New York: ACM.
[26]
Ramalingam, V. and Wiedenbeck, S. (1997). "An Empirical Study of Novice Program Comprehension in the Imperative and Object-Oriented Styles". Papers presented at the seventh workshop on Empirical studies of programmers, 124--139.
[27]
Sellen, A. J. (1995). Remote conversations: The effects of mediating talk with technology. Human-Computer Interaction, 10, 401--444.
[28]
Soloway, E, Bonar, J. and Elrich, K (1982). "Tapping into tacit programming knowledge". Proceedings of the first major conference on Human factors in computers systems,.52--57.
[29]
Spohrer, J.C, and Soloway, E. (1986a). "Alternatives to construct-based programming misconceptions". ACM SIGCHI Bulletin, Conference proceedings on Human factors in computing systems. Volume 17 Issue 4.
[30]
Spohrer, J. C. and Soloway, E. (1986b) "Novice mistakes: are the folk wisdoms correct?". Communications of the ACM. Volume 29 Issue 7.
[31]
Spohrer, J. C., Soloway, E, and Pope, E. (1985). "Where the Bugs Are". CHI '85Proceedings, 47--53.
[32]
Tang, J. and Isaacs, E. (1993). Why do users like video? Studies of multimedia-supported collaboration. Computer Supported Cooperative Work, 11, 163--196.
[33]
Weiser, M. (1982) "Programmers Use Slices When Debugging". Communications of the ACM. Volume 25 Issue 7, 446--453.
[34]
Whittaker, S. (1995) Rethinking video as a technology for interpersonal communications: theory and design implications. International Journal of Man-Machine Studies, 42, 501--529.
[35]
Whittaker, S. and Geelhoed, E. (1993). Shared workspaces: How do they work and when are they useful? International Journal of Man-Machine Studies, 39, 813--842

Cited By

View all

Index Terms

  1. Another person's eye gaze as a cue in solving programming problems

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICMI '04: Proceedings of the 6th international conference on Multimodal interfaces
    October 2004
    368 pages
    ISBN:1581139950
    DOI:10.1145/1027933
    Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 13 October 2004

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. debugging
    2. eye tracking
    3. gaze-based & attentional interfaces
    4. mediated communication
    5. programming
    6. visual co-presence

    Qualifiers

    • Article

    Conference

    ICMI04
    Sponsor:

    Acceptance Rates

    Overall Acceptance Rate 453 of 1,080 submissions, 42%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)26
    • Downloads (Last 6 weeks)4
    Reflects downloads up to 06 Nov 2024

    Other Metrics

    Citations

    Cited By

    View all

    View Options

    Get Access

    Login options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media