introduction to data warehousing (athens it professionals meetup)
TRANSCRIPT
![Page 1: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/1.jpg)
Introduction toData Warehousing
Athens IT Professionals Meetup2017-01-10
![Page 2: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/2.jpg)
What is a “Data Warehouse”
![Page 3: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/3.jpg)
Why do I need one?
Combines data from separate systems for a cross-system analysis
Business Intelligence Dashboards
Compare historic information over time
Can be used as an “archive” (although there are less costly solutions for this)
Makes data available to users who might not have access or be able to access it natively
“Analysts” can explore data instead of “programmers”
(SQL knowledge versus API/Programming knowledge)
![Page 4: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/4.jpg)
Use Cases
Reporting
Analytics
Dashboards
Alerts
![Page 5: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/5.jpg)
How much work is it?
Hopefully this talk is a good start
Expect to spend a month playing with things and learning before you can do anything useful.
Tools are probably going to cost several hundred dollars/month minimum
![Page 6: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/6.jpg)
Confused?Lots of products do several pieces of the puzzle
![Page 7: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/7.jpg)
Components of the Stack
Raw Data Sources
Data Extraction / Transformation / Load
Data Warehouse (Database)
Visualization / Reporting
![Page 8: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/8.jpg)
![Page 9: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/9.jpg)
ETL has changed over time as data warehouse software has gotten more powerful
![Page 10: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/10.jpg)
Data Sources
Text, CSV Files
SQL Servers
Log files
Any Application that stores data
Via Export, API, Web scrape, etc
![Page 11: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/11.jpg)
Getting Data to the Warehouse
Direct load from CSV
Segment.io
Flydata.com
Zappier
Stitchdata
Custom integrations
Google “import X to data warehouse”
![Page 12: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/12.jpg)
Data Warehouses
AWS Redshift
Microsoft Azure
IBM
Astera
Terradata
Google Bigquery
Hadoop
Many others
![Page 13: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/13.jpg)
Data Visualization and Reporting
SQL Tools:SQL Workbench
Data Grip
Most general-purpose SQL tools
Visualization Tools
Periscope
Looker
AWS Quicksite
Tableau
Dashboard Tools
Hundreds of options
![Page 14: Introduction to Data Warehousing (Athens IT Professionals Meetup)](https://reader034.vdocument.in/reader034/viewer/2022051404/58ea38101a28ab61358b5b71/html5/thumbnails/14.jpg)
Thank you
Questions?