Boost by Popularity: Using Engagement Data in Document Ranking

Posted: 22 Nov 2019

Date Written: November 22, 2019

Abstract

Customer feedback, validated by historical engagement data, showed that navigational queries consistently under-performed. By analysing the click curve distributions for these queries we were able to hypothesise that including document popularity as a relevance signal could address this particular customer need and positively impact other documents frequently engaged with below the fold.

For this piece of work, we created a Python algorithm to generate query-document pairs scores, and were able to introduce them successfully in our search engine algorithm. This allows us to add a new signal to our relevance calculation.

We have since resolved many of our customer issues and report a significant increase in DCG overall.

Keywords: relevance, popularity, engagement data

Suggested Citation

Heitkamp, Doug and Tolram, Mark and Vaillant, Julien, Boost by Popularity: Using Engagement Data in Document Ranking (November 22, 2019). Proceedings of the 3rd Annual RELX Search Summit, Available at SSRN: https://ssrn.com/abstract=3491866

Doug Heitkamp (Contact Author)

LexisNexis ( email )

P. O. Box 933
Dayton, OH 45401
United States

Mark Tolram

LexisNexis ( email )

P. O. Box 933
Dayton, OH 45401
United States

Julien Vaillant

LexisNexis ( email )

P. O. Box 933
Dayton, OH 45401
United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Abstract Views
115
PlumX Metrics