intelligent systems lecture 23 introduction to intelligent data analysis (ida). example of system...
TRANSCRIPT
Intelligent Systems
Lecture 23Introduction to Intelligent Data Analysis
(IDA). Example of system for Data Analyzing based on neural networks
Synonyms of IDA
• Data mining
• Knowledge discovery, in particular, Knowledge Discovery in Databases (KDD)
• Knowledge acquisition
Data Mining: Definition
• Data Mining is a collection of technologies which employ modern analysis techniques and computer power to find structure in data.
• Data Mining is composed of several branches, each of which attempts to solve a different problem.
Place of KDD in Decision support system (in medicine)
Place of Data Mining in Knowledge Discovery(Jiavei Han, Micheline Kamber “Data Mining.
Concepts and techniques”)
Data Mining: Ontology
• Predictive Modeling
• Clustering
• Deviation Detection
• Text Mining
• Link Analysis
• Etc. ...
Data Mining: Modeling
• Predictive Modeling attempts to predict values of future cases based on historical examples
• 90+% of all data mining is modeling
• Two major types:– estimation– classification
• Related to statistical regression
Data Mining: Clustering
• Clustering attempts to separate cases into ‘natural’ groupings.
• Strictly, there are no ‘right answers’
• Tends to be compute intensive
• Very popular in marketing, as market segmentation
Data Mining: Deviation Detection
• Deviation detection identifies cases which are ‘unexpected’
• All algorithms assume some model of ‘normality’- what is expected
• Related to outlier detection in conventional statistics
Data Mining: Text Mining
• Text mining includes several, different methods for discovering structure in documents.
• The most common text mining applications are search and retrieval tools.
Data Mining: Link Analysis
• Link analysis searches for indirect connections between items
• Primarily employed in fraud detection and law enforcement
• Link analysis tools typically include a data visualization component
Structure of software AnalDB
Shell
DLL
DLL
…
Modules
with NNsDatabase
User
BDE
GUI, generation of reports
Control of NN
Reading from Database, Options,
Commands