Experiments with filtered detection of similar academic papers

Yaakov HaCohen-Kerner, Aharon Tayeb

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations


In this research, we investigate the issue of efficient detection of similar academic papers. Given a specific paper, and a corpus of academic papers, most of the papers from the corpus are filtered out using a fast filter method. Then, 47 methods (baseline methods and combinations of them) are applied to detect similar papers, where 34 of the methods are variants of new methods. These 34 methods are divided into three new method sets: rare words, combinations of at least two methods, and compare methods between portions of the papers. Results achieved by some of the 34 heuristic methods are better than the results of previous heuristic methods, comparing to the results of the "Full Fingerprint" (FF) method, an expensive method that served as an expert. Nevertheless, the run time of the new methods is much more efficient than the run time of the FF method. The most interesting finding is a method called CWA(1) that computes the frequency of rare words that appear only once in both compared papers. This method has been found as an efficient measure to check whether two papers are similar.

Original languageEnglish
Title of host publicationArtificial Intelligence
Subtitle of host publicationMethodology, Systems, and Applications - 15th International Conference, AIMSA 2012, Proceedings
Number of pages13
StatePublished - 2012
Externally publishedYes
Event15th International Conference on Artificial Intelligence: Methodology, Systems, and Applications, AIMSA 2012 - Varna, Bulgaria
Duration: 12 Sep 201215 Sep 2012

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume7557 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349


Conference15th International Conference on Artificial Intelligence: Methodology, Systems, and Applications, AIMSA 2012


  • Corpus
  • Detection
  • Filtering
  • Fingerprinting
  • Heuristic methods
  • Similar academic papers


Dive into the research topics of 'Experiments with filtered detection of similar academic papers'. Together they form a unique fingerprint.

Cite this