Enhanced mean retrieval score estimation for query performance prediction

Haggai Roitman; Shai Erera; Oren Sar-Shalom; Bar Weiner

doi:10.1145/3121050.3121051

Enhanced mean retrieval score estimation for query performance prediction

Haggai Roitman, Shai Erera, Oren Sar-Shalom, Bar Weiner

IBM

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

24 Scopus citations

Abstract

We study the problem of mean retrieval score estimation for query performance prediction (QPP). We propose an enhanced estimator which estimates the mean based on calibrated retrieval scores. Each document score is adjusted based on features that model potential tradeoffs that may exist in the retrieval process of that specific document. Using the proposed estimator, we derive several previously suggested QPP methods, from which we gather an initial set of calibration features. Based on these features and few additional ones, we propose two estimator instantiations. Using an evaluation over several TREC benchmarks, we demonstrate the effectiveness of our estimation approach.

Original language	English
Title of host publication	ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval
Publisher	Association for Computing Machinery, Inc
Pages	35-42
Number of pages	8
ISBN (Electronic)	9781450344906
DOIs	https://doi.org/10.1145/3121050.3121051
State	Published - 1 Oct 2017
Externally published	Yes
Event	7th ACM SIGIR International Conference on the Theory of Information Retrieval, ICTIR 2017 - Amsterdam, Netherlands Duration: 1 Oct 2017 → 4 Oct 2017

Publication series

Name	ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval

Conference

Conference	7th ACM SIGIR International Conference on the Theory of Information Retrieval, ICTIR 2017
Country/Territory	Netherlands
City	Amsterdam
Period	1/10/17 → 4/10/17

Bibliographical note

Publisher Copyright:
© 2017 Copyright held by the owner/author(s).

Access to Document

10.1145/3121050.3121051

Cite this

Roitman, H., Erera, S., Sar-Shalom, O., & Weiner, B. (2017). Enhanced mean retrieval score estimation for query performance prediction. In ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval (pp. 35-42). (ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval). Association for Computing Machinery, Inc. https://doi.org/10.1145/3121050.3121051

Roitman, Haggai ; Erera, Shai ; Sar-Shalom, Oren et al. / Enhanced mean retrieval score estimation for query performance prediction. ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval. Association for Computing Machinery, Inc, 2017. pp. 35-42 (ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval).

@inproceedings{82b9b4adf1a0410a9b6d642b58729ace,

title = "Enhanced mean retrieval score estimation for query performance prediction",

abstract = "We study the problem of mean retrieval score estimation for query performance prediction (QPP). We propose an enhanced estimator which estimates the mean based on calibrated retrieval scores. Each document score is adjusted based on features that model potential tradeoffs that may exist in the retrieval process of that specific document. Using the proposed estimator, we derive several previously suggested QPP methods, from which we gather an initial set of calibration features. Based on these features and few additional ones, we propose two estimator instantiations. Using an evaluation over several TREC benchmarks, we demonstrate the effectiveness of our estimation approach.",

author = "Haggai Roitman and Shai Erera and Oren Sar-Shalom and Bar Weiner",

note = "Publisher Copyright: {\textcopyright} 2017 Copyright held by the owner/author(s).; 7th ACM SIGIR International Conference on the Theory of Information Retrieval, ICTIR 2017 ; Conference date: 01-10-2017 Through 04-10-2017",

year = "2017",

month = oct,

day = "1",

doi = "10.1145/3121050.3121051",

language = "אנגלית",

series = "ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval",

publisher = "Association for Computing Machinery, Inc",

pages = "35--42",

booktitle = "ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval",

}

Roitman, H, Erera, S, Sar-Shalom, O & Weiner, B 2017, Enhanced mean retrieval score estimation for query performance prediction. in ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval. ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval, Association for Computing Machinery, Inc, pp. 35-42, 7th ACM SIGIR International Conference on the Theory of Information Retrieval, ICTIR 2017, Amsterdam, Netherlands, 1/10/17. https://doi.org/10.1145/3121050.3121051

Enhanced mean retrieval score estimation for query performance prediction. / Roitman, Haggai; Erera, Shai; Sar-Shalom, Oren et al.
ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval. Association for Computing Machinery, Inc, 2017. p. 35-42 (ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Enhanced mean retrieval score estimation for query performance prediction

AU - Roitman, Haggai

AU - Erera, Shai

AU - Sar-Shalom, Oren

AU - Weiner, Bar

PY - 2017/10/1

Y1 - 2017/10/1

N2 - We study the problem of mean retrieval score estimation for query performance prediction (QPP). We propose an enhanced estimator which estimates the mean based on calibrated retrieval scores. Each document score is adjusted based on features that model potential tradeoffs that may exist in the retrieval process of that specific document. Using the proposed estimator, we derive several previously suggested QPP methods, from which we gather an initial set of calibration features. Based on these features and few additional ones, we propose two estimator instantiations. Using an evaluation over several TREC benchmarks, we demonstrate the effectiveness of our estimation approach.

AB - We study the problem of mean retrieval score estimation for query performance prediction (QPP). We propose an enhanced estimator which estimates the mean based on calibrated retrieval scores. Each document score is adjusted based on features that model potential tradeoffs that may exist in the retrieval process of that specific document. Using the proposed estimator, we derive several previously suggested QPP methods, from which we gather an initial set of calibration features. Based on these features and few additional ones, we propose two estimator instantiations. Using an evaluation over several TREC benchmarks, we demonstrate the effectiveness of our estimation approach.

UR - http://www.scopus.com/inward/record.url?scp=85033215460&partnerID=8YFLogxK

U2 - 10.1145/3121050.3121051

DO - 10.1145/3121050.3121051

M3 - ???researchoutput.researchoutputtypes.contributiontobookanthology.conference???

AN - SCOPUS:85033215460

T3 - ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval

SP - 35

EP - 42

BT - ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval

PB - Association for Computing Machinery, Inc

T2 - 7th ACM SIGIR International Conference on the Theory of Information Retrieval, ICTIR 2017

Y2 - 1 October 2017 through 4 October 2017

ER -

Roitman H, Erera S, Sar-Shalom O, Weiner B. Enhanced mean retrieval score estimation for query performance prediction. In ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval. Association for Computing Machinery, Inc. 2017. p. 35-42. (ICTIR 2017 - Proceedings of the 2017 ACM SIGIR International Conference on the Theory of Information Retrieval). doi: 10.1145/3121050.3121051

Enhanced mean retrieval score estimation for query performance prediction

Abstract

Publication series

Conference

Bibliographical note

Access to Document

Other files and links

Fingerprint

Cite this