what's on your wish list?
TRANSCRIPT
![Page 1: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/1.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75551
Bo BorlandVP Field Technical Sales, Pentaho
Twitter: @boborland
June 2015
Blending Hadoop & MongoDB with Pentaho
![Page 2: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/2.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75552
About this session
Today You Will Learn
… to prepare and blend MongoDB and Hadoop data for reporting and analyses
Agenda❯ Overview and preparation❯ Blending data❯ Information presentation
![Page 3: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/3.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75553
The Universe of Data is Exploding And Data is Connecting People & Things
New Technology Paradigms have Emerged
1
2
3
New data architectures must blend and analyze all data regardless of source
Users will consume analytics in new ways: data driven apps
![Page 4: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/4.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75554 © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75554 © 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75554
Entry
Tran
sform
Advanced
Op
tim
ize
What The Market Is Deploying Today And Planning For Tomorrow
Data Warehouse Optimization
Data Refinery
Big Data Exploration
Customer 360 Degree View
Internet of Things
Next Generation Applications
Internal Big Data as a Service
On-Demand Big Data Blending
Big Data Predictive Analytics
Use Case Complexity
Busi
ness
Im
pact
Monetize My Data
Data Warehouse Optimization
Data Warehouse Optimization
Data Refinery
360 Degree View
A Spectrum of Big Data Use Cases
Internet of Things
![Page 5: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/5.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75555 © 2013, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75555 © 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75555
Blending the Two Worlds Together
2014,
Customer
Billing
ProvisioningBI TOOLSDATA MARTSEDW
![Page 6: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/6.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75556
Blending the Two Worlds Together
Customer
Billing
ProvisioningBI TOOLSDATA MARTSEDW
Location
Sensors
NetworkWeb
Social Media
Blending the Two Worlds Together
![Page 7: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/7.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75557
Blending the Two Worlds Together
EDW
Customer
Billing
Provisioning
Location
Sensors
NetworkWeb
Social Media
DATA MARTS
SKILLS
TIME
GOVERNANCE
FLEXIBILITY
COST/VALUE
Blending the Two Worlds Together
![Page 8: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/8.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75558
Big Data Blending: Example Overview
❯ Fictional e-commerce data for retail sales
❯ Want to promote product sales through website wish-lists
❯ We have been promoting wish-lists
❯ How is this affecting sales?
❯ Combine web-hits and sales data
![Page 9: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/9.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-75559
Big Data Blending: Example Overview
Web server data
Analytics Business User
TrendsSales data
PDI
Archive Aggregate
Web Clicks
Real-time
Ecommerce
Sales
![Page 10: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/10.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755510
Big Data Blending: Query MongoDB
❯ Discover MongoDB collection information
❯ Obtain sales information
❯ Use the MongoDB aggregation framework (ELT)
![Page 11: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/11.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755511
Big Data Blending: Example Overview
Web server data
Real-time
Ecommerce
Sales
![Page 12: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/12.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755512
Big Data Blending: Prepare Hadoop
❯ Process relevant web log lines
❯ Derive information from web log lines
❯ Aggregate by month, log line type
❯ Store intermediate data
❯ Typically schedule daily
❯ Run inside of the Hadoop cluster (ELT)
![Page 13: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/13.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755513
Big Data Blending: Example Overview
Web server data
Archive Aggregate
Web Clicks
Mapper
Reducer
![Page 14: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/14.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755514
DEMONSTRATION ❯Pentaho Map/Reduce
![Page 15: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/15.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755515
Big Data Blending: Hits vs Sales
❯ Join with Hadoop and Mongo web-hits and sales data
❯ De-normalize hits and sales metrics
❯ Blend data on a month level
❯ Make the information available as a virtual database table
![Page 16: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/16.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755516
Big Data Blending: Example Overview
PDI
Blended Sales Data
![Page 17: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/17.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755517
DEMONSTRATION ❯Blending
![Page 18: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/18.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755518
Summary
What We Covered Today:❯ PDI big data handling is easy and scalable❯ PDI blending removes the need to stage big data❯ Analytics and data integration are “better together”
![Page 19: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/19.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755519
Next Steps
Want to learn more?❯Take these next steps
❯Try it out yourself!
❯Visit our documentation for samples
❯Talk to us!
![Page 20: What's on Your Wish List?](https://reader034.vdocument.in/reader034/viewer/2022050923/55b38b83bb61eb67748b45f9/html5/thumbnails/20.jpg)
© 2015, Pentaho. All Rights Reserved. pentaho.com. Worldwide +1 (866) 660-755520
Thank You
blog.pentaho.com
@Pentaho
Facebook.com/Pentaho
Pentaho Business Analytics
JOIN THE CONVERSATION. YOU CAN FIND US ON: