header

Relevance Feedback between Hypertext and Semantic Web Search: Frameworks and Evaluation

23 Pages Posted: 22 Jun 2018 Publication Status: Accepted

See all articles by Harry Halpin

Harry Halpin

University of Edinburgh; W3C World Wide Web Consortium

Victor Lavrenko

University of Edinburgh

Abstract

We investigate the possibility of using Semantic Web data to improve hypertext Web search. In particular, we use relevance feedback to create a 'virtuous cycle' between data gathered from the Semantic Web of Linked Data and web-pages gathered from the hypertext Web. Previous approaches have generally considered the searching over the Semantic Web and hypertext Web to be entirely disparate, indexing and searching over different domains. While relevance feedback has traditionally improved information retrieval performance, relevance feedback is normally used to improve rankings over a single data-set. Our novel approach is to use relevance feedback from hypertext Web results to improve Semantic Web search, and results from the Semantic Web to improve the retrieval of hypertext Web data. In both cases, an evaluation is performed based on certain kinds of informational queries (abstract concepts, people, and places) selected from a real-life query log and checked by human judges. We evaluate our work over a wide range of algorithms and options, and show it improves baseline performance on these queries for deployed systems as well, such as the Semantic Web Search engine FALCON-S and Yahoo! Web search. We further show that the use of Semantic Web inference seems to hurt performance, while the pseudo- relevance feedback increases performance in both cases, although not as much as actual relevance feedback. Lastly, our evaluation is the first rigorous 'Cranfield' evaluation of Semantic Web search.

Keywords: semantic search, query logs, information retrieval, relevance feedback, evaluation, semantic web, Linked Data

Suggested Citation

Halpin, Harry and Lavrenko, Victor, Relevance Feedback between Hypertext and Semantic Web Search: Frameworks and Evaluation (2011). Journal of Web Semantics First Look, Available at SSRN: https://ssrn.com/abstract=3199537 or http://dx.doi.org/10.2139/ssrn.3199537

Harry Halpin (Contact Author)

University of Edinburgh ( email )

Old College
South Bridge
Edinburgh, Scotland EH8 9JY
United Kingdom

W3C World Wide Web Consortium ( email )

United States

Victor Lavrenko

University of Edinburgh ( email )

Old College
South Bridge
Edinburgh, Scotland EH8 9JY
United Kingdom

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Abstract Views
260
Downloads
7
PlumX Metrics