Impact-ED - A New Model of Digital Library Impact Evaluation
Pages 100 - 105
Abstract
This paper presents Impact-ED, a new model for digital library impact evaluation. The model draws on assumptions from the Theory of Planned Behaviour and the Sense-Making Model. The paper discusses the current shortfalls of digital library impact evaluation and presents an alternative. Knowledge and attitude are put forward as potential measures of impact and different methods are triangulated and data linked to provide a comprehensive picture of the impact of the library at the time of use. The model shows how the digital library is being used to benefit users in their work, how it is changing their knowledge and attitudes and how the information found is used in real-time in the real world. It is being tested in the healthcare domain on the National Resource for Infection Control (www.nric.org.uk) but is expected to be transferable to other domains as further work will prove.
References
[1]
National Program for IT, http://www.npfit.nhs.uk/default.asp
[2]
National Knowledge Service, http://www.nks.nhs.uk/
[3]
Marshall, J.G.: The Impact of the Hospital Library on Clinical Decision Making: The Rochester Study. Bull. Med. Libr. Assoc. 80, 169-178 (1992).
[4]
O'Connor, P.: Determining the Impact of Health Library Services on Patient Care: A Review of the Literature. Health Inf. Libr. J. 19, 1-13 (2002).
[5]
King, D.N.: The Contribution of Hospital Library Information Services to Clinical Care: A Study in Eight Hospitals. Bull. Med. Libr. Assoc. 75, 291-301 (1987).
[6]
Klein, M.S., Ross, F.V., Adams, D.L., Gilbert, C.M.: Determining the Impact of Health Library Services on Patient Care: A Review of the Literature. Acad. Med. 69, 489-495 (1994).
[7]
Cullen, R.: Evaluating Digital Libraries in the Health Sector. Part 2: Measuring Impacts and Outcomes. Health Inf. Libr. J. 21, 3-13 (2004).
[8]
Cullen, R.: Evaluating Digital Libraries in the Health Sector. Part 1: Measuring Inputs and Outputs. Health Inf. Libr. J. 20, 195-204 (2003).
[9]
Cullen, R., Esson, R.: Assessing the Impact of Information Services in the Health Sector. Health Inf. Libr. J. 24(s1), 1-3 (2007).
[10]
Urquhart, C.: Assessing Impact: Let Us Count the Ways? Libr. Inf. Update 4(12), 26 (2005).
[11]
Weightman, A.L., Williamson, J.: The Value and Impact of Information Provided Through Library Services for Patient Care: A Systematic Review. Health Inf. Libr. J. 22(1), 4-25 (2005).
[12]
Madle, G., Kostkova, P., Roudsari, A.: The Impact of Healthcare Digital Libraries: a Systematic Review of Evaluation Methods (in preparation, 2008).
[13]
Fox, E., Marchionini, G.: Progress Towards Digital Libraries: Augmentation Through Integration. Inform. Process. Manag. 35, 219-225 (1999).
[14]
Ajzen, I.: The Theory of Planned Behavior. Organ. Behav. Hum. Dec. 50, 179-211 (1991).
[15]
Dervin, B.: Audience as Listener and Learner, Teacher and Confidante: The Sense-Making Approach. In: Dervin, B., Foreman-Wernet, L., Lauterbach, E. (eds.) Sense-making Methodology Reader: Selected Writings of Brenda Dervin, pp. 215-232. Hampton Press, Cresskill (2003).
[16]
Dervin, B.: A Theoretic Perspective and Research Approach for Generating Research Helpful to Communication Practice. In: Dervin, B., Foreman-Wernet, L., Lauterbach, E. (eds.) Sense-making Methodology Reader: Selected Writings of Brenda Dervin, pp. 251- 268. Hampton Press, Cresskill (2003).
[17]
Dervin, B.: Sense-making Instrument. Sense-making Home Page, http://communication.sbs.ohio-state.edu/ sense-making/inst/idervin97tech.html
[18]
Madle, G., Kostkova, P., Roudsari, A.: Impact-ED: The development of a new Digital Library Evaluation Model (in preparation, 2008).
[19]
Evalued Toolkit, http://www.evalued.uce.ac.uk/index.htm
[20]
Choudhury, S., Hobbs, B., Lorie, M., Flores, N., Coleman, A., Martin, M., Kuhlman, D.L., McNair, J.H., Rhodes, W.A., Tipton, R., Agnew, G., Nicholson, D., Macgregor, G.: A Framework for Evaluating Digital Library Services. D-Lib. 8(7-8) (2002).
[21]
Digiqual Website, http://www.digiqual.org/digiqual/index.cfm
[22]
Conyers, A.: The E-measures Project: Developing Statistical Measures for Electronic Information Services. In: E-measures Conference (2004).
[23]
Clarke, Z.: Equinox: Library Performance Measurement and Quality Management System. Learn. Res. J. 16(2), 28-31 (2000).
[24]
Miller, R., Schmidt, S.: E-metrics: Measures for Electronic Resources. In: 4th Northumbria International Conference on Performance Measurement in Libraries and Information Services, Washington, DC (2001).
[25]
Franklin, B., Plum, T.: Successful Web Survey Methodologies for Measuring the Impact of Networked Electronic Services (MINES for Libraries). IFLA 32(1), 28-40 (2006).
[26]
Reeves, T.C., Apedo, X., Young, H.W.: Evaluating Digital Libraries: A User Friendly Guide. National Science Digital Library (2003), http://eduimpact.comm.nsdl.org/evalworkshop/UserGuideOct20.doc
- Impact-ED - A New Model of Digital Library Impact Evaluation
Recommendations
Users' evaluation of digital libraries (DLs): Their uses, their criteria, and their assessment
Millions of dollars have been invested into the development of digital libraries. There are many unanswered questions regarding their evaluation, in particular, from users' perspectives. This study intends to investigate users' use, their criteria and ...
What impact do healthcare digital libraries have? An evaluation of national resource of infection control at the point of care using the Impact-ED framework
Over the last decade billions of dollars' worth of investments have been directed into ICT solutions for healthcare. In particular, new evidence-based digital libraries and web portals designed to keep busy clinicians up to date with the latest evidence ...
An exploration of the research trends in the digital library evaluation domain
JCDL '12: Proceedings of the 12th ACM/IEEE-CS joint conference on Digital LibrariesEvaluation is a vital research area in the digital library domain, demonstrating a growing literature in conference and journal papers. In this poster we present the research trends that governed the field within the decade 2001--2010 in the JCDL and ...
Comments
Information & Contributors
Information
Published In
September 2008
457 pages
ISBN:9783540875987
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 14 September 2008
Author Tags
Qualifiers
- Article
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 27 Dec 2024