A new and versatile method for association generation

Amihood Amir, Ronen Feldman, Reuven Kashi

Research output: Contribution to journalArticlepeer-review

38 Scopus citations

Abstract

Current algorithms for finding associations among the attributes describing data in a database have a number of shortcomings: 1. Their performance time grows dramatically as the minimum support is reduced. Consequently, applications that require associations with very small support have prohibitively large running times. 2. They assume a static database. Some applications require generating associations in real-time from a dynamic database, where transactions are constantly being added and deleted. There are no existing algorithms to accommodate such applications. 3. They can only find associations of the type where a conjunction of attributes implies a conjunction of different attributes. It turns out that there are many cases where a conjunction of attributes implies another conjunction only in case certain other attributes are excluded. To our knowledge, there is no current algorithm that can generate such excluding associations. We present a novel method for association generation, that answers all three above desiderata. Our method is inherently different from all existing algorithms, and especially suitable to textual databases with binary attributes. At the heart of our algorithm lies the use of subword trees for quick indexing into the required database statistics. We tested our algorithm on the Reuters-22173 database with satisfactory results.

Original languageEnglish
Pages (from-to)333-347
Number of pages15
JournalInformation Systems
Volume22
Issue number6-7
DOIs
StatePublished - 1997

Bibliographical note

Funding Information:
Acknowledgements - The first author was partially supportedb y NSF grant CCR-9610170 and the Israel Ministry of Science and the Arts grant 6297. The second author was partially supported by the Israel Ministry of Science and the Arts grant 8615. The authors warmly thank an anonymousr efereew hose insightful commentsh elped both the presentationa nd content of the paper.

Keywords

  • Association Generation
  • Data Mining
  • Excluding Association
  • Knowledge Discovery in Textual Data Bases

Fingerprint

Dive into the research topics of 'A new and versatile method for association generation'. Together they form a unique fingerprint.

Cite this