Rapid detection of similar peer-reviewed scientific papers via constant number of randomized fingerprints

Yaakov HaCohen-Kerner, Aharon Tayeb

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

This research is concerned with the detection of similar academic papers. Given a tested paper from a given corpus of 10,099 peer-reviewed scientific papers, a two-stage process was activated. During the first stage, most of the papers were filtered out using a fast filter method. In the second stage, in order to detect similar papers we applied 23 heuristic variants derived from 3 novel prototype methods using various parameter settings. The three novel prototype methods are: CT-TR – Constant Number of randomized T fingerprints, compared to each one-third of R (first/middle/last) fingerprints, CT-AR: Constant Number of randomized T fingerprints, compared to all R fingerprints, and CDT-AR: Constant Number of divided randomized T fingerprints compared, to all R fingerprints. Results achieved by the new methods are superior to those of previous heuristic methods, which were approximations of the “Full Fingerprint” (FF) method, currently considered the best heuristic method. The order of this new methods' run-time, Θ(n), is far more efficient than the order of the FF method run-time, Θ(n2) (after removing short documents from the corpus).

Original languageEnglish
Pages (from-to)70-86
Number of pages17
JournalInformation Processing and Management
Volume53
Issue number1
DOIs
StatePublished - 1 Jan 2017
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2016 Elsevier Ltd

Funding

This work was partially funded by an internal research grant from Jerusalem College of Technology , Lev Academic Center. The authors thank Alex Klein, Shlomo Engelberg, and two anonymous reviewers for their help and fruitful comments.

FundersFunder number
Jerusalem College of Technology
Jerusalem College of Technology - Lev Academic Center

    Keywords

    • Fingerprinting
    • Heuristic methods
    • Plagiarism detection
    • Similar peer-reviewed scientific papers

    Fingerprint

    Dive into the research topics of 'Rapid detection of similar peer-reviewed scientific papers via constant number of randomized fingerprints'. Together they form a unique fingerprint.

    Cite this