horton works hdp 2.5 sandpit on microsoft azure v0 5
TRANSCRIPT
![Page 1: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/1.jpg)
INSTALLING
HORTONWORKS
HDP 2.5 SANDBOX
VM ON MICROSOFT
AZUREJeff Moss
Oramoss Ltd
![Page 2: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/2.jpg)
CONTENTS
About Me
HortonWorks
Microsoft Azure
Installation Of Hortonworks HDP 2.5 on Microsoft Azure
Prerequisites
Create VM
Set Firewall Rules
Change Passwords
Access Ambari
![Page 3: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/3.jpg)
ABOUT ME
Independent Consultant
Working with “big data” long before it became trendy!
Extensive Oracle background
25 years experience from Oracle 5 onwards
Former presenter UKOUG
Currently Supplying Services To E.On UK
Lead Technical Architect role
75TB Relational Enterprise Data Warehouse
Support for several other European warehouses
Contact Me
http://www.oramoss.com
http://www.oramoss.com/blog
![Page 4: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/4.jpg)
MICROSOFT AZURE
Microsoft Cloud platform
2nd largest by share, behind Amazon (AWS)
A collection of cloud services
Most trusted cloud (compliance certifications)
More geographical regions than Amazon
Vendor Services
Microsoft, Oracle, SAP…
Open Source tools and technologies
Linux, Docker, Chef, Puppet, GitLab, WordPress…
Windows or Linux OS
Big Data, Machine Learning, Blockchain, IoT, Microservices
IAAS, PAAS, DBAAS, SAAS
![Page 5: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/5.jpg)
HORTONWORKS HDP
Commercial Hadoop Distribution
One of the major distributions
Partnership with Microsoft to deliver on Azure (Cloud)
![Page 6: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/6.jpg)
HORTONWORKS HDP SANDBOX
Prebuilt environment
Virtualised
VMWare
VirtualBox
Docker
Useful for test and learn
![Page 7: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/7.jpg)
PREREQUISITES
Must Haves:
A Microsoft Azure account
I used the free month trial which gives £125 credit
An SSH Client
A Web Browser
Optional (Not really)
A generated public/private key pair
![Page 8: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/8.jpg)
NAVIGATE TO THE PORTAL
DASHBOARD
![Page 9: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/9.jpg)
SEARCH FOR HORTONWORKS SANDBOX WITH HDP 2.5
![Page 10: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/10.jpg)
SELECT THE HDP 2.5 VARIANT, PRESS
CREATE
![Page 11: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/11.jpg)
CONFIG STEP 1 – BASIC SETTINGS
![Page 12: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/12.jpg)
CONFIG STEP 2 - SIZE
![Page 13: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/13.jpg)
CONFIG STEP 3 - SETTINGS
![Page 14: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/14.jpg)
CONFIG STEP 4 – SUMMARY PAGE
![Page 15: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/15.jpg)
CONFIG STEP 5 – BUY
![Page 16: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/16.jpg)
DEPLOYING
![Page 17: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/17.jpg)
ONCE FINISHED DEPLOYING
![Page 18: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/18.jpg)
CLICK ON THE HDP25SANDBOX
![Page 19: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/19.jpg)
ADD A DNS NAME LABEL
![Page 20: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/20.jpg)
INBOUND SECURITY RULES
![Page 21: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/21.jpg)
INBOUND SECURITY RULES
![Page 22: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/22.jpg)
INBOUND SECURITY RULES
Create additional rules for accessing optional components
default-allow-4200 (Web SSH Access)
default-allow-50070 (Default Name Node)
default-allow-21000 (Atlas)
default-allow-9995 (Zeppelin)
default-allow-15000 (Falcon)
default-allow-6080 (Ranger)
![Page 23: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/23.jpg)
SSH ACCESS
![Page 24: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/24.jpg)
CHANGE PASSWORDS
Login as jeff
sudo su – root
Set a new password for root (previously hadoop)
Run ambari-admin-password-reset
Set a new password for admin
![Page 25: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/25.jpg)
HTTP ACCESS
![Page 26: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/26.jpg)
AFTER ENTERING DETAILS
![Page 27: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/27.jpg)
LAUNCH DASHBOARD (LHS)
![Page 28: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/28.jpg)
WE’RE IN!
![Page 29: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/29.jpg)
BACK TO HDP MAIN ENTRY
![Page 30: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/30.jpg)
WEB BASED SSH ACCESS
![Page 31: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/31.jpg)
WEB SSH TERMINAL
![Page 32: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/32.jpg)
SIMPLE HDFS ACCESS
![Page 33: Horton works hdp 2.5 sandpit on microsoft azure v0 5](https://reader034.vdocument.in/reader034/viewer/2022051521/5a68192a7f8b9a7e348b543b/html5/thumbnails/33.jpg)
SIMPLE HDFS COMMANDS