skip to main content
article
Free access

Behavioral evaluation and analysis of a hypertext browser

Published: 01 March 1989 Publication History

Abstract

Students performed a variety of tasks using a statistics text presented either in conventional printed form or via the text browser “SuperBook” (Remde, Gomez and Landauer [18]). Students using SuperBook answered more search questions correctly, wrote higher quality “open-book” essays, and recalled certain incidental information better than students using the conventional text. Subjective ratings overwhelmingly favored SuperBook. The advantage of SuperBook appears to be particularly strong for questions that are not anticipated by the author's organization of a text.

References

[1]
Allison, D.R. Electronic publishing technologies {Special Issue}. IEEE Computer, 21, 1 (jail. 1988).
[2]
Becker, R.A. and Chambers, J.M. S An Interactive Environment for Data Analysis and Graphics. Wadsworth, Belmont, Calif., 1984.
[3]
Bush, V. As we may think. Atlantic Monthly, 76, 1 (Jan. 1945), 101-108.
[4]
Conklin, J. Hy~rtext: An introduction and survey. IEEE Computer, 20, 9 (Sept. 1987), 17-41.
[5]
Deerwester, S., Dumais, S.T., Fumas, G.W., Landauer, T.K., and Harshman, R.A. Indexing by latent semantic analysis. JASIS, in press.
[6]
Dumais, S.T., Fumas, G.W., Landauer, T.K., Deerwester, S. and Harshman, R. Using latent semantic analysis to improve access to textual information. In Proceedings of CHI'88 (Washington, D.C., May 15-19). ACM, New York, 1988, pp. 281-285.
[7]
Engelbart, D.C., and English, W.K. A research center for augmenting human intellect. In Proceedings of the 1968 Fall Joint Computer Conference AFIPS Press, Momvale, N.J., 1968, pp. 395-410.
[8]
Fumas, G.W. Experience with an adaptive indexing scheme. Proceedings of CHI'85 (San Francisco, Apr. 14-18). ACM, New York, 1985, pp. 131-135.
[9]
Fumas, G.W. Generalized fisheye views. In Proceedings of CHI'86 (Boston, Apr. 13-17). ACM, New York, 1986, pp. 16-23.
[10]
Fumas, G.W., Landauer, T.K., Gomez, L.M., and Dumais, S.T. Statistical semantics: Analysis of the potential performance of key-word information systems. Bell System Technical Journal, 62, 6, 1983, pp. 1753-1806.
[11]
Gomez, L.M. and Lochbaum, C.C. People can retrieve more objects with enriched key-word vocabularies. But is there a human performance cost? In B. Shackel (Ed.), Human-Computer Interaction - Interact '84. North Holland, Amsterdam, 1984, pp. 257-261.
[12]
Gomez, L.M., Lochbaum, C.C. and Landauer, T.K. All the right words: A study of human performance and key-word information retrieval. JASIS, in press.
[13]
Marchionini, G. and Shneiderman, B. Finding facts vs. browsing knowledge in hypertext systems. IEEE Computer, 21, 1 (Jan. 1988), 70-80.
[14]
Mantei, M.M. A study of disorientation behavior in ZOG. Doctoral dissertation. University of Southern California, Los Angeles, 1982.
[15]
McCracken, D.L. and Akscyn, R.M. Experience with the ZOG human-computer interface system. Int. J. Man-Mach. St., 21, 1984, 293-310.
[16]
Nelson, T.H. Getting it out of our system. In G. Schechter (Ed.), Information Retrieval: A Critical Review. Thompson Books, Washington, D.C., 1967, pp. 191-210.
[17]
Perlman, G. An overview of SAM: A hypertext interface to Smith & Mosier's. Technical Report TR-87-09. Wang institute, Tyngsboro, Mass., 1987.
[18]
Remde, J.R., Gomez, L.M., and Landauer, T.K. SuperBook: An Automatic Tool for Information Exploration--Hypertext? In Proceedings of Hypertext '87. University of North Carolina, Chapel Hill, 1987, pp. 175-188.
[19]
Shneiderman, B. Designing the user interface: strategies for effective human-computer interaction. Addison-Wesley, Reading, Mass., 1987.
[20]
Smith, J.B. and Weiss, S.F. Hypertext {Special
[21]
Walker, J.H. Document Examiner: Delivery interface for hypertext documents. In Proceedings of Hypertext '87. University of North Carolina, Chapel Hill, 1987, pp. 307-323.

Cited By

View all

Recommendations

Reviews

Danny B. Lange

This paper reports on an experiment and a behavioral evaluation of a text browser called SuperBook. SuperBook takes one or more existing documents in a standard text formatting language as input and presents the text in a multiwindow display with search and navigation enhancements. The users in the experiment were 20 university students. The experiment consisted of one training session followed by five evaluation sessions. In the training session, each user was given a tutorial introduction to SuperBook. Then they were assigned randomly to work with a selected text in conventional print or SuperBook form. In the evaluation sessions, a variety of tasks were performed. Structured search tasks required the users to find the answer to a specific question by using the reference text. Open-book essays required the users to look up material in different places in the text and to write about the information. Incidental learning tasks required the users to acquire additional information about a text while performing typical tasks without explicit directions to attend to the additional information. Finally, subjective ratings assessed the users' reaction to the form (printed or SuperBook) and the content (a text on statistics). For all four tasks, SuperBook was easier to use than conventional printed material. SuperBook produced more accurate searches (structured search); SuperBook users wrote essays that were judged superior to those written by users of printed material (open-book essays); SuperBook users recalled more chapter headings (incidental learning); and SuperBook users rated the text much easier to use than the printed text users did (subjective ratings). This is one of the first papers on the comparison of hypertext and paper materials. It not only shows the advantages of a hypertext system but also suggests which properties of the system are important under various conditions. Anyone interested in hypertext should read this paper.

Access critical reviews of Computing literature here

Become a reviewer for Computing Reviews.

Comments

Information & Contributors

Information

Published In

cover image ACM SIGCHI Bulletin
ACM SIGCHI Bulletin  Volume 20, Issue SI
March 1989
374 pages
ISSN:0736-6906
DOI:10.1145/67450
Issue’s Table of Contents
  • cover image ACM Conferences
    CHI '89: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
    March 1989
    397 pages
    ISBN:0897913019
    DOI:10.1145/67449
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 March 1989
Published in SIGCHI Volume 20, Issue SI

Check for updates

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)89
  • Downloads (Last 6 weeks)18
Reflects downloads up to 26 Jan 2025

Other Metrics

Citations

Cited By

View all

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Login options

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media