Unexpectedness as a Measure of Interestingness in Knowledge Discovery

30 Pages Posted: 13 Oct 2008

See all articles by Balaji Padmanabhan

Balaji Padmanabhan

University of Pennsylvania - Operations & Information Management Department

Alexander Tuzhilin

New York University (NYU) - Leonard N. Stern School of Business; New York University (NYU) - Department of Information, Operations, and Management Sciences

Date Written: 1997

Abstract

Organizations are taking advantage of "data-mining" techniques to leverage the vast amounts ofdata captured as they process routine transactions. Data-mining is the process of discoveringhidden structure or patterns in data. However several of the pattern discovery methods in dataminingsystems have the drawbacks that they discover too many obvious or irrelevant patternsand that they do not leverage to a full extent valuable prior domain knowledge that managershave. This research addresses these drawbacks by developing ways to generate interestingpatterns by incorporating managers' prior knowledge in the process of searching for patterns indata. Specifically we focus on providing methods that generate unexpected patterns with respectto managerial intuition by eliciting managers' beliefs about the domain and using these beliefs toseed the search for unexpected patterns in data. Our approach should lead to the development ofdecision support systems that provide managers with more relevant patterns from data and aid ineffective decision making.

Keywords: Interestingness of Patterns, Unexpectedness, Beliefs, Belief-driven Rule Discovery

Suggested Citation

Padmanabhan, Balaji and Tuzhilin, Alexander, Unexpectedness as a Measure of Interestingness in Knowledge Discovery (1997). NYU Working Paper No. 2451/14168, Available at SSRN: https://ssrn.com/abstract=1283010

Balaji Padmanabhan

University of Pennsylvania - Operations & Information Management Department ( email )

Philadelphia, PA 19104
United States

Alexander Tuzhilin

New York University (NYU) - Leonard N. Stern School of Business ( email )

44 West 4th Street
Suite 9-160
New York, NY NY 10012
United States

New York University (NYU) - Department of Information, Operations, and Management Sciences

44 West Fourth Street
New York, NY 10012
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
80
Abstract Views
869
Rank
551,205
PlumX Metrics