article

Free access

Efficient passage ranking for document databases

Editor: W. Bruce Croft Authors:

Marcin Kaszkiel,

Ron Sacks-DavisAuthors Info & Claims

ACM Transactions on Information Systems (TOIS), Volume 17, Issue 4

Pages 406 - 439

https://doi.org/10.1145/326440.326445

Published: 01 October 1999 Publication History

Abstract

Queries to text collections are resolved by ranking the documents in the collection and returning the highest-scoring documents to the user. An alternative retrieval method is to rank passages, that is, short fragments of documents, a strategy that can improve effectiveness and identify relevant material in documents that are too large for users to consider as a whole. However, ranking of passages can considerably increase retrieval costs. In this article we explore alternative query evaluation techniques, and develop new tecnhiques for evaluating queries on passages. We show experimentally that, appropriately implemented, effective passage retrieval is practical in limited memory on a desktop machine. Compared to passage ranking with adaptations of current document ranking algorithms, our new “DO-TOS” passage-ranking algorithm requires only a fraction of the resources, at the cost of a small loss of effectiveness.

References

[1]

ALLAN, J. 1995. Relevance feedback with too much data. In Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Re-trieval (SIGIR '95, Seattle, WA, July 9-13), E. A. Fox, P. Ingwersen, and R. Fidel, Eds. ACM Press, New York, NY, 337-343.

[2]

ANH,V.N.AND MOFFAT, A. 1998. Compressed inverted files with reduced decoding overheads. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '98, Melbourne, Australia, Aug. 24-28), W. B. Croft, A. Moffat, C. J. van Rijsbergen, R. Wilkinson, and J. Zobel, Eds. ACM Press, New York, NY, 290-297.

[3]

BELL,T.C.,MOFFAT, A., WITTEN,I.H.,AND ZOBEL, J. 1995. The MG retrieval system: Compressing for space and speed. Commun. ACM 38, 4 (Apr. 1995), 41-42.

[4]

BERTINO, E., OOI, B., SACKS-DAVIS, R., TAN, K.-L., AND ZOBEL, J. 1997. Text databases. In Indexing Techniques for Advanced Database Systems Kluwer Academic Publishers, Hing-ham, MA.

[5]

BROWN, E. W. 1995. Fast evaluation of structured queries for information retrieval. In Proceedings of the 18th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '95, Seattle, WA, July 9-13), E. A. Fox, P. Ingwersen, and R. Fidel, Eds. ACM Press, New York, NY, 30-38.

[6]

BUCKLEY,C.AND LEWIT, A. F. 1985. Optimization of inverted vector searches. In Proceedings of the eighth annual international ACM SIGIR conference on Research and Development in Information Retrieval (SIGIR '85, Montr~al, P.Q., Canada, June 5-7, 1985), J. M. Tague, Ed. ACM Press, New York, NY, 97-110.

[7]

CALLAN, J. P. 1994. Passage-level evidence in document retrieval. In Proceedings of the 17th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '94, Dublin, Ireland, July 3-6), W. B. Croft and C. J. van Rijsbergen, Eds. Springer-Verlag, New York, NY, 302-310.

[8]

CLARKE,C.L.A.,CORMACK,G.V.,AND BURKOWSKI, F. J. 1995. Shortest substring ranking MultiText experiments for TREC-4. In Proceedings of the 4th Text Retrieval Conference (TREC-4, Washington, D.C., Nov.), D. K. Harman, Ed. National Institute of Standards and Technology, Gaithersburg, MD, 295-304.

[9]

CLARKE, C., CORMACK, G., AND TUDHOPE, E. 1997. Relevance ranking for one to three term queries. In Proceedings of the 5th RIAO Conference 388-412.

[10]

CORMACK, G., PALMER, C., BIESBROUCK, M., AND CLARKE, C. 1998. Deriving very short queries for high precision and recall. In Proceedings of the 7th Text Retreival Conference (TREC-7)

[11]

FRAKES,W.B.AND BAEZA-YATES, R., Eds. 1992. Information Retrieval: Data Structures and Algorithms. Prentice-Hall, Inc., Upper Saddle River, NJ.

[12]

FULLER, M., KASZKIEL, M., KIM, D., NG, C., ROBERTSON, J., WILKINSON, R., WU, M., AND ZOBEL, J. 1998. TREC 7 ad hoc, speech, and interactive tracks at MDS/CSIRO. In Proceedings of the 7th Text Retreival Conference (TREC-7)

[13]

FULLER, M., KASZKIEL, M., NG, C., VINES, P., WILKINSON, R., AND ZOBEL, J. 1997. MDS TREC 6 report. In Proceedings of the 6th Text Retreival Conference (TREC-6, Nov.), E. Voorhees and D. Harman, Eds. 241-258.

[14]

HARMAN, D. K. 1995. Overview of the second text retrieval conference (TREC-2). Inf. Process. Manage. 31, 3 (May-June), 271-289.

[15]

HARMAN,D.AND CANDELA, G. 1990. Retrieving records from a gigabyte of text on a minicomputer using statistical ranking. J. Am. Soc. Inf. Sci. 41, 8, 581-589.

[16]

HEARST,M.A.AND PLAUNT, C. 1993. Subtopic structuring for full-length document access. In Proceedings of the 16th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '93, Pittsburgh, PA, June 27-July), R. Korfhage, E. Rasmussen, and P. Willett, Eds. ACM Press, New York, NY, 59-68.

[17]

KASZKIEL,M.AND ZOBEL, J. 1997. Passage retrieval revisited. In Proceedings of the 20th Annual International ACM Conference on Research and Development in Information Re-trieval (SIGIR '97, Philadelphia, PA, July 27-31), N. J. Belkin, A. D. Narasimhalu, P. Willett, W. Hersh, F. Can, and E. Voorhees, Eds, ACM Press, New York, NY, 178-185.

[18]

MITRA, M., SINGHAL, A., AND BUCKLEY, C. 1998. Improving automatic query expansion. In Proceedings of the 21st Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '98, Melbourne, Australia, Aug. 24-28), W. B. Croft, A. Moffat, C. J. van Rijsbergen, R. Wilkinson, and J. Zobel, Eds. ACM Press, New York, NY, 206-214.

[19]

MITTENDORF,E.AND SCH~UBLE, P. 1994. Document and passage retrieval based on hidden Markov models. In Proceedings of the 17th Annual International ACM Conference on Research and Development in Information Retrieval (SIGIR '94, Dublin, Ireland, July 3-6), W. B. Croft and C. J. van Rijsbergen, Eds. Springer-Verlag, New York, NY, 318-327.

[20]

MOFFAT,A.AND ZOBEL, J. 1996. Self-indexing inverted files for fast text retrieval. ACM Trans. Inf. Syst. 14, 4, 349-379.

[21]

MOFFAT, A., ZOBEL, J., AND KLEIN, S. 1995. Improved inverted file processing for large text databases. In Proceedings of the 6th Australasian Database Conference (Adelaide, Jan.), R. Sacks-Davis and J. Zobel, Eds. 162-171.

[22]

PERSIN, M. 1996. Efficient implementation of text retrieval techniques. RMIT, Melbourne, Australia.

[23]

PERSIN, M., ZOBEL, J., AND SACKS-DAVIS, R. 1996. Filtered document retrieval with frequency-sorted indexes. J. Am. Soc. Inf. Sci. 47, 10, 749-764.

[24]

SALTON, G. 1989. Automatic Text Processing: The Transformation, Analysis, and Retrieval of Information by Computer. Addison-Wesley Series in Computer Science. Addison-Wesley Longman Publ. Co., Inc., Reading, MA.

[25]

SALTON,G.AND BUCKLEY, C. 1991. Automatic text structuring and retrieval-experiments in automatic encyclopedia searching. In Procedings of the 14th Annual International ACM SIGIR Conference on Research and Development in Information Retrieval (SIGIR '91, Chicago, IL, Oct. 13-16), E. Fox, Ed. ACM Press, New York, NY, 21-30.

Cited By

Bhole MKastner WSauter T(2023)Knowledge Representation of Asset Information and Performance in OT Environments2023 IEEE 28th International Conference on Emerging Technologies and Factory Automation (ETFA)10.1109/ETFA54631.2023.10275721(1-8)Online publication date: 12-Sep-2023
https://doi.org/10.1109/ETFA54631.2023.10275721
Albarede LMulhem PGoeuriot LMarié SLe Pape-Gardeux CChardin-Segui T(2023)Heterogeneous graph attention networks for passage retrievalInformation Retrieval10.1007/s10791-023-09424-326:1-2Online publication date: 16-Nov-2023
https://dl.acm.org/doi/10.1007/s10791-023-09424-3
Mihǎescu MPopescu PBurdescu D(2015)J48 list ranker based on advanced classifier decision tree inductionInternational Journal of Computational Intelligence Studies10.1504/IJCISTUDIES.2015.0728794:3/4(313-324)Online publication date: 1-Nov-2015
https://dl.acm.org/doi/10.1504/IJCISTUDIES.2015.072879
Show More Cited By

Index Terms

Efficient passage ranking for document databases

Recommendations

Enhancing relevance models with adaptive passage retrieval
ECIR'08: Proceedings of the IR research, 30th European conference on Advances in information retrieval

Passage retrieval and pseudo relevance feedback/query expansion have been reported as two effective means for improving document retrieval in literature. Relevance models, while improving retrieval in most cases, hurts performance on some heterogeneous ...
A passage-based approach to learning to rank documents
Abstract
According to common relevance-judgments regimes, such as TREC’s, a document can be deemed relevant to a query even if it contains a very short passage of text with pertinent information. This fact has motivated work on passage-based document ...
Completely-arbitrary passage retrieval in language modeling approach
AIRS'08: Proceedings of the 4th Asia information retrieval conference on Information retrieval technology

Passage retrieval has been expected to be an alternative method to re-solve length-normalization problem, since passages have more uniform lengths and topics, than documents. An important issue in the passage retrieval is to determine the type of the ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Information Systems

ACM Transactions on Information Systems Volume 17, Issue 4

Oct. 1999

123 pages

ISSN:1046-8188

EISSN:1558-2868

DOI:10.1145/326440

Editor:
W. Bruce Croft
Univ. of Massachusetts, Amherst

Issue’s Table of Contents

Copyright © 1999 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 October 1999

Published in TOIS Volume 17, Issue 4

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

62
Total Citations
View Citations
1,081
Total Downloads

Downloads (Last 12 months)72
Downloads (Last 6 weeks)12

Reflects downloads up to 07 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Bhole MKastner WSauter T(2023)Knowledge Representation of Asset Information and Performance in OT Environments2023 IEEE 28th International Conference on Emerging Technologies and Factory Automation (ETFA)10.1109/ETFA54631.2023.10275721(1-8)Online publication date: 12-Sep-2023
https://doi.org/10.1109/ETFA54631.2023.10275721
Albarede LMulhem PGoeuriot LMarié SLe Pape-Gardeux CChardin-Segui T(2023)Heterogeneous graph attention networks for passage retrievalInformation Retrieval10.1007/s10791-023-09424-326:1-2Online publication date: 16-Nov-2023
https://dl.acm.org/doi/10.1007/s10791-023-09424-3
Mihǎescu MPopescu PBurdescu D(2015)J48 list ranker based on advanced classifier decision tree inductionInternational Journal of Computational Intelligence Studies10.1504/IJCISTUDIES.2015.0728794:3/4(313-324)Online publication date: 1-Nov-2015
https://dl.acm.org/doi/10.1504/IJCISTUDIES.2015.072879
Costa ABuccio EMelucci M(2015)A Document Retrieval Model Based on Digital Signal FilteringACM Transactions on Information Systems10.1145/280978734:1(1-37)Online publication date: 22-Sep-2015
https://dl.acm.org/doi/10.1145/2809787
Na S(2015)Two-Stage Document Length Normalization for Information RetrievalACM Transactions on Information Systems10.1145/269966933:2(1-40)Online publication date: 17-Feb-2015
https://dl.acm.org/doi/10.1145/2699669
Kong WAktolga EAllan JHe QIyengar ANejdl WPei JRastogi R(2013)Improving passage ranking with user behavior informationProceedings of the 22nd ACM international conference on Information & Knowledge Management10.1145/2505515.2505719(1999-2008)Online publication date: 27-Oct-2013
https://dl.acm.org/doi/10.1145/2505515.2505719
Stewénius HGunderson SPilet J(2012)Size MattersProceedings, Part II, of the 12th European Conference on Computer Vision --- ECCV 2012 - Volume 757310.5555/2964398.2964449(674-687)Online publication date: 7-Oct-2012
https://dl.acm.org/doi/10.5555/2964398.2964449
Stewénius HGunderson SPilet J(2012)Size Matters: Exhaustive Geometric Verification for Image Retrieval Accepted for ECCV 2012Computer Vision – ECCV 201210.1007/978-3-642-33709-3_48(674-687)Online publication date: 2012
https://doi.org/10.1007/978-3-642-33709-3_48
Dulac-Arnold GDenoyer LGallinari P(2011)Text classificationProceedings of the 33rd European conference on Advances in information retrieval10.5555/1996889.1996943(411-423)Online publication date: 18-Apr-2011
https://dl.acm.org/doi/10.5555/1996889.1996943
Ding SAttenberg JBaeza-Yates RSuel TKing INejdl WLi H(2011)Batch query processing for web search enginesProceedings of the fourth ACM international conference on Web search and data mining10.1145/1935826.1935858(137-146)Online publication date: 9-Feb-2011
https://dl.acm.org/doi/10.1145/1935826.1935858
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Get Access

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

Media

Figures

Other

Tables

View Issue’s Table of Contents