user data warehouse warehouse dbms a dbms b dbms c database data warehouse example
Post on 18-Dec-2015
267 Views
Preview:
TRANSCRIPT
User
Data Warehouse Warehouse
DBMS A DBMS B DBMS C
Database Database Database
Data warehouse example
User
DataMining Tools
Data WarehouseManager
Warehouse
DBMS A DBMS B DBMS C
Database Database Database
Data mining versus data warehousing
DataMiner
DataWarehouse
Database ManagementSystems
Warehouse Data
for Mining
Data for Warehousing
Database
Data
for Mining
Database systems, data warehousing, and mining
User
Warehouse Miner:Integrated Data Warehouse
and Data Miner
Warehouse
DBMS A DBMS B DBMS C
Database Database Database
Integrated data warehousing and data mining
User
DataMining Tools
Data WarehouseManager
Warehouse
DBMS A DBMS B DBMS C
Database Database Database
Data mining versus data warehousing
DataMiner
DataWarehouse
Database ManagementSystems
Warehouse DataFor Mining
Data forWarehousing
Database DataFor Mining
Database systems, data warehousing, and mining
User
Warehouse Miner,Integrated Data Warehouse
And Data MinerWarehouse
DBMS A DBMS B DBMS C
Database Database Database
Integrated data warehousing and data mining
StatisticalReasoning
DataWarehouse
Database ManagementSystems
Warehouse Data
For Mining
Data for
Warehousing
Database Data
For Mining
Statistical packages operating on databases
Data Mining Tool
Database Management System Database
Loose integration between a DBMS and a data miner
Database Management System+
Data Mining ToolDatabase
Tight integration between a DBMS and a data miner
Relation
Extractor
Object Database
Relational Database
Patterns Data Miner
Mining object databases
DataMiningTools
AuditDatabase
Mining an audit database
VisualizationTool
Database ManagementSystems
Data
To
Visualize
Request
Data
Database and visualization
Query Processor
MetadataManager
IntegrityManager
Transaction Processor
StorageManager
SecurityManager
Data Miner
Mining
DBMS
Functions of a mining DBMS
Query + Data Processor Miner
MetadataManager
StorageManager
IntegrityManager
SecurityManager
Mining
DBMS
Data mining as part of query processing
DataManagement
Warehousing
MachineLearning Mining
KnowledgeManagement
HumanComputerInteraction
Statistics
Decision support technologies
Decision SupportSystem Data
Miner
Data Warehouse
Database ManagementSystem
Results from Mining
Warehouse Data
For Mining
Data for
Warehousing
Database Data
For Mining
Decision support and multimedia data mining
Data Warehouse
Database ManagementSystems
Warehouse Data
For Mining
Data for
Warehousing
Database Data
For Mining
Machine learning and data mining
MachineLearning
Multimedia Communication, Network,Operating System
Multimedia Database System
Multimedia Data Warehouse
Multimedia Data Miner
DecisionSupport
Pyramid for multimedia mining
DatabaseSystem A
DatabaseSystem B
Middleware
MultimediaData Miner
Data Warehouse
Revisiting the data mining architecture
•Relational and Object Databases
•Multimedia Databases •Distributed, Heterogenous, and•Legacy Databases
•Security •Metadata •Visualization •Parallel Processing
•Warehouse•Machine Learning•Statistical Reasoning
Data
Support
Techniques
Three-dimensional view
Integration:
Middleware, Web
Client 1Client 2 Server
DatabaseSystem
Network
Server Warehouse
ServerData Miner
Client-server-based data mining
Client
Object
ServerDatabaseSystem
Object
Object Request Broker
ServerDataMiner
Object ServerDataWarehouse
Object
Data mining through an ORB
BookObject
Introduction
Set of Sections
References
Data model for text
QueryProcessor
Browser/Editor
Metadata Manager
UpdateProcessor
Security/IntegrityManager
Functional Architecture for a text processing system
Data MiningTool
Structured
Data
Unstructured Data
Converting unstructured data to structured data for mining
Determine DataSets Build Models
DevelopTrainingExamples
Classify NewData based onthe Models andExamples
Identify Patterns
Operation of data mining techniques
Data MiningTool
InformationRetrievalSystem
DataSource
Augmenting an information retrieval system
Data MiningTool
Unstructured
Data
Mining directly on unstructured data
TrueText Mining System
Extracting Structured Data fromText
Text Retrieval with SimpleMining
Intelligent Text Retrieval
Text Understanding System
Text Retrieval System
Taxonomy for text mining
ImageObject
Left Part ofImage
Center Part ofImage
Right Part ofImage
Data model for an image
QueryProcessor
Browser/Editor
Metadata Manager
UpdateProcessor
Security/IntegrityManager
Functional architecture for an image processing system
IMAGE MINING
Unusual Pattern
True Image Mining System
Extracting Structured Data from Images
Image Retrieval with Simple Mining
Intelligent Image Retrieval
Image Understanding System
Image Retrieval System
Taxonomy for image mining
VideoObject
AdvertisementsMain Film
FutureAttractions
Data model for video
QueryProcessor
Browser/Editor
Metadata Manager
UpdateProcessor
Security/IntegrityManager
Functional architecture for a video processing system
Video Frames
Summary Reports
Text Miner
PatternsandResults
Mining text extracted from video
Video Scripts/PatternsAs Metadata
Video Database Video InformationRetrieval
VideoMining
Patterns andTrends
Direct video mining
True Text Mining System
Extracting Structured Data from Text
Text Retrieval with SimpleMining
Intelligent Text RetrievalSchema
Text Understanding System
Text Retrieval System
Taxonomy for video mining
AudioObject
Speech
Applause
Questions
Data model for audio
QueryProcessor
Browser/Editor
Metadata Manager
UpdateProcessor
Security/IntegrityManager
Functional architecture for an audio processing system
Audio Frames
SpeechTranscription:Text Data
Text Miner
PatternsAndResults
Mining text extracted from audio
Audio Scripts/Patternsas Metadata
Audio MiningAudio/SpeechProcessing System
AudioDatabase
Patterns and Trends
Direct audio mining
True Audio Mining System
Extracting Structured Data from Audio
Audio Retrieval with Simple Mining
Intelligent Audio Retrieval
Audio Understanding System
Audio Retrieval System
Taxonomy for audio mining
Multimedia Data Miner
Integrated View of Multimedia Database
DMP DMP DMP
Text DBMS Video DBMS Audio DBMS
Text Database Video Database Audio Database
Integration and then mining
Integrating the Results
DMP DMP DMP
Text Miner Video Miner Audio Miner
Text DBMS Video DBMS Audio DBMS
Text Database Video Database Audio Database
Integrating the results of various data miners
Mining Tool C Mining Tool D
Internet AccessModule for C
Internet AccessModule for D
INTERNET
Internet AccessModule for A
Internet AccessModule for B
DBMSVendor A
DBMSVendor B
Database A Database B
Data mining through the Web
KnowledgeDiscovery
PatternDiscovery Knowledge
Mining
DataDredging
Data Mining
DataArcheology
The process of discovering meaningful new correlations,Patterns, and trends by sifting through large amounts ofstored data, using pattern recognition technologies and Statistical and mathematical techniques.
Different definitions of data mining
OutcomesOf Data Mining
Data MiningTechniques Approaches to
Data Mining
HowData Miningis carried out
Aspects of data mining
Security andPrivacy
MultimediaMining
DataMiningTrends
Web Mining MiningDistributed,
Heterogeneous, andLegacy Databases
MetadataMining
Data mining trends
QualityDatabase
Data MinerTo Improve
Quality
Database
Data MinerTo DetectPatterns
Patterns andTrends
Data quality and data mining
Data MiningTool
VisualizationTool
DBMS
Interactive data mining
DataMining
Algorithms
ParallelProcessingTechniques
ParallelizedData MiningAlgorithms
Parallel data mining
TrainingExamples
AnalyzingData
ProducingResults
Data mining functions
Thin Client
Middle Tier:Data Mining Components
Server DBMS
Three-tier architecture for data miner
Object
Data Miner Object
Object Request Broker
Results Pruner
Object ReportGenerator
Object
Encapsulating data mining modules as objects
Data SourceIntegrator
Medical:Diagnosis
InlandRevenueService:Analyze TaxReturns
Retail/Wholesale:Marketing And Sales
Data Mining
Financial:EconomicAnalysis
Intelligence:Foreign AffairsAnalysis
Education:StudentPromotion
Some data mining application areas
RelationalDatabases Files Multimedia
Databases
Paper
Humans WorldWideWeb
Data, data and more data
What we do with the data?
Mine, mine, and mine
Until we get useful information.
Why data mining?
IntegrateDataSources
Clean/ModifyData
Sources
MineThe Data
ExamineResults/PruneResults
ReportFinalResults
Data
Sources
Steps of mining data
Results fromData Miner
Knowledge-BasedSystem and/orHuman Analystfor PruningResults
Pruned Results
KnowledgeBase
Real-WorldKnowledge
Pruning the results
InadequateTools
Data MiningChallenges
Bad QualityData
Incomplete andIncorrect Data Inadequate
Training
Some data mining challenges
SQL QueryGenerator
ApplicationGenerator
ReportGenerator
SelectOutcomes
SelectApproaches
SelectTechniques
Example user interface for mining
Data Mining Tasks (Outcomes):Classification, Clustering,Association, Deviation Detection
Data Mining Techniques(Algorithms):Neural NetworksInductive Logic ProgrammingDecision Trees, Nearest Neighbour
Data Mining Methodologies(Approaches):Top-DownBottom-Up(Supervised or Unsupervised)Hybrid
Data mining tasks, techniques, and methodologies
DetermineInitial Set ofExpectedOutcomes
Carry OutData MiningTechniques
ExtractPatterns
DetermineNewOutcomesfrom thePatternsObserved
Data mining outcomes
Data MiningApproaches/Methodologies
Top-Down:Start with hypothesis and validate hypothesis,Hypothesis may be formed, initially from bottom-up approach or from some real-world knowledge,If hypothesis is not satisfied, then revise hypothesis
Bottom-up: Analyze the data and extract patterns,Directed/Supervised: You have some idea what you are lookingfor, Undirected/Unsupervised, You have no idea what you arelooking for
Some data mining approaches
StatisticsDecisionSupport
DatabaseManagementandWarehousing
DataMining
MachineLearning
VisualizationParallelProcessing
Data mining technologies
top related