how universities use big data to transform education
Post on 09-Jan-2017
104 Views
Preview:
TRANSCRIPT
HDInsight for Higher EducationKaren McGregor
Microsoft Canada
Machine Learning and Analytics
Big Data Stores
Action
People
Automated Systems
Apps
Web
Mobile
Bots
Intelligence
Dashboards & Visualizations
Cortana
Bot Framework
Cognitive Services
Power BI
Information Management
Event Hubs
Data Catalog
Data Factory
HDInsight (Hadoop and Spark)
Stream Analytics
Intelligence
Data Lake Analytics
Machine Learning
SQL Data Warehouse
Data Lake Store
Data Sources
Apps
Sensors and devices
Data
Big Data as part of Cortana Intelligence
*IDC study “The Business Value and TCO Advantage of Apache Hadoop in the Cloud with Microsoft Azure HDInsight”
Azure HDInsight
Hadoop and Spark as a Service on Azure
Fully-managed Hadoop and Spark for the cloud100% Open Source Hortonworks data platformClusters up and running in minutes Managed, monitored and supported by Microsoft with the industry’s best SLAFamiliar BI tools for analysis, or open source notebooks for interactive data science63% lower TCO than deploy your own Hadoop on-premises*
The Business Value and TCO of HDInsight
• 418% 5-year ROI• Four month payback period• 63% 5-year lower TCO than on-
premises• 66% staff efficiencies than on-
premises• Get it at http://aka.ms/hdinsight
*IDC study “The Business Value and TCO Advantage of Apache Hadoop in the Cloud with Microsoft Azure HDInsight”
RESOURCES ACROSS THE SALES CYCLE
© 2016 Microsoft Corporation. All rights reserved.
Page 6 © Hortonworks Inc. 2011 – 2014. All Rights Reserved
Hortonworks: Hadoop for Higher EducationSingle View of a Student
December 2016
Page 7 © Hortonworks Inc. 2011 – 2014. All Rights Reserved
Research Schools
One Use Case: Genome Sequencing
20,000 Genes 1,000,000,000 variables = 20 Billion Rows of Data Storage of this data is challenging – Complexities of Cancer make for
even more data Legacy platforms lack storage and processing power Distributing the data over multiple nodes changes the game
Page 8 © Hortonworks Inc. 2011 – 2014. All Rights Reserved
Research Schools
Hadoop, Hortonworks Data Platform and HDInsight (H3)
Gives individual researchers as much power as a team of researcher The Next Generation Cyber Capability (NGCC) architecture follows President Obama’s “National Cancer Moonshot” guidelines, with a federated framework that encourages data sharingOne query against a table with 20 billion rows would time out before it could return results. In Hadoop it returned results in 1-2 minutes
Page 9 © Hortonworks Inc. 2011 – 2014. All Rights Reserved
View of the Student
A single view leads to student success, satisfaction, and security:• Tailor offerings• Find opportunities for
guidance• Provide consistent student
experience• Secure campus
FinancialAid
Guidance
Teacher reported
info
Admission
CampusSecurity
Page 10 © Hortonworks Inc. 2011 – 2014. All Rights Reserved
Today’s Data Architectures Inhibit a Single View
1. Data Silos: disparate views of each student
2. Volume Limitations: cannot store and process all student data in the EDW
3. New Data Sources: unable to capture and use new data to complete the view
AN
ALY
TIC
SD
ATA
SYST
EMS
3
Clickstream Web & Social
Geolocation Sensor & Machine
Server Logs
Unstructured
SOU
RC
ES
RDBMS CRMCRM
Systems of Record
Enterprise Data Warehouse
1
App App
ODS
App VisualizationData Marts
2
Page 11 © Hortonworks Inc. 2011 – 2014. All Rights Reserved
Hortonworks Single View
Single Data Repository
• Resolve student data across repositories
• Provide administrators, teachers, counselors, and analysts with a single view of data
Optimized Storage
• Eliminate unnecessary silos to reduce costs
• Store more data about each student
Analytical Flexibility
• Dynamic schema on read removes limitations of other “single view” applications
Hor
tonw
orks
Clickstream Web & Social
Geolocation Sensor & Machine
Server Logs
Unstructured
SOU
RC
ES
Existing Systems
Admissions Finance Security
AN
ALY
TIC
S
Data Marts
Business Analytics
Visualization& Dashboards
AN
ALY
TIC
S
Applications Business Analytics
Visualization& Dashboards
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
°
HDFS (Hadoop Distributed File System)
YARN: Data Operating System
Interactive Real-TimeBatch SearchBatch BatchMPP
EDW
Page 12 © Hortonworks Inc. 2011 – 2014. All Rights Reserved
Single View Use Cases – Higher Education
AcquireNew Students
• Develop marketing campaigns based on a complete view of student activities
• Create incentives and messaging based on student patterns and real-time activity
• Modify marketing and advertising using new sources of data
RetainCurrent Students
• Personalize student services with a complete view of student activity and preferences
• Ensure a consistent student experience across all institutional facilities
• Identify “trouble” or “exceptional” students via social media to resolve issues proactively
GrowStudent Lifetime Value
• Analyze new data sources to determine the next best step in a student’s learning path
• Identify students to nurture in targeted programs
• Offer opportunities to students based on paths made by others with similar profiles
Page 13 © Hortonworks Inc. 2011 – 2014. All Rights Reserved
Single View Case Studies – Commercial Sector
AcquireNew Customers
A digital media company improves online ad placement for major retailers by combining new data sources for a single view of online behavior.
RetainCurrent Customers
A major retailer combines customer detail across systems to improve personalization, raise the customer experience, and increase customer loyalty.
GrowCustomer Lifetime Value
A major telco infers demographics in family accounts to gain a clearer picture of the entire account and identify cross-sell and up-sell opportunities.
Page 14 © Hortonworks Inc. 2011 – 2014. All Rights Reserved
Will I Benefit from a Single View?
• How many systems house student data in your environment?
• Are you able to bring together student data into a single view?
• Are you applying new data sources (clickstream, geolocation, social) to gain a more complete picture of students?
• Do different business units handle student data separately?
• Do students complain about an inconsistent experience?
• How do your admission and retention rates compare to your competition?
FinancialAid
Guidance
Teacher reported
info
Admission
CampusSecurity
Page 15 © Hortonworks Inc. 2011 – 2014. All Rights Reserved
Thank You
top related