from mapreduce to apache spark
Post on 23-Jan-2018
936 Views
Preview:
TRANSCRIPT
1©Cloudera,Inc.Allrightsreserved.
FromMapReduce toApacheSpark:AnEcosystemEvolvesDougCutting(@cutting)ChiefArchitect/ApacheHadoopCo-founder
2©Cloudera,Inc.Allrightsreserved.
TheMergingEcosystems
3©Cloudera,Inc.Allrightsreserved.
Genomics(Broad Institute)
Physics(CERN)
Healthcare Delivery(CHOA)
TheNewUseCasesareAmazing
4©Cloudera,Inc.Allrightsreserved.
BringYourQuestions AboutLivytotheClouderaBooth
Livy.io
• ForsubmittingSparkjobsfromanyweb/mobileapp,withnoSparkclientinstall — enablingnewarchitecturesandusecases
• Providesmulti-tenancyandfaulttolerancetosupportmultipleusersreliably
• Works instandalonemode,withYARN,orwithMesos
• Nocodechangesneeded
• ApacheLicense.Initialcontributors includeemployeesofCloudera,Intel, andMicrosoft+morewanted!
NewContribution:Livy,anOpenSourceRESTServiceforSpark(Alpha)
5©Cloudera,Inc.Allrightsreserved.
Thankyou@cutting
cloudera.com/spark
top related