PHIRST: A distributed architecture for P2P information retrieval

Avi Rosenfeld, Claudia V. Goldman, Gal A. Kaminka, Sarit Kraus

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

Recent progress in peer to peer (P2P) search algorithms has presented viable structured and unstructured approaches for full-text search. We posit that these existing approaches are each best suited for different types of queries. We present PHIRST, the first system to facilitate effective full-text search within P2P databases. PHIRST works by effectively leveraging between the relative strengths of these approaches. Similar to structured approaches, agents first publish terms within their stored documents. However, frequent terms are quickly identified and not exhaustively stored, resulting in a significant reduction in the system's storage requirements. During query lookup, agents use unstructured search to compensate for the lack of fully published terms. Additionally, they explicitly weigh between the costs involved in structured and unstructured approaches, allowing for a significant reduction in query costs. Finally, we address how node failures can be effectively addressed through storing multiple copies of selected data. We evaluated the effectiveness of our approach using both real-world and artificial queries. We found that in most situations our approach yields near perfect recall. We discuss the limitations of our system, as well as possible compensatory strategies.

Original languageEnglish
Pages (from-to)290-303
Number of pages14
JournalInformation Systems
Volume34
Issue number2
DOIs
StatePublished - Apr 2009

Bibliographical note

Funding Information:
This material is based upon work supported in part by ISF Grant # 1685/07.

Keywords

  • Distributed databases
  • Information retrieval
  • Peer to peer systems

Fingerprint

Dive into the research topics of 'PHIRST: A distributed architecture for P2P information retrieval'. Together they form a unique fingerprint.

Cite this