how universities use big data to transform education

HDInsight for Higher EducationKaren McGregor

Microsoft Canada

Machine Learning and Analytics

Big Data Stores

Action

People

Automated Systems

Apps

Web

Mobile

Bots

Intelligence

Dashboards & Visualizations

Cortana

Bot Framework

Cognitive Services

Power BI

Information Management

Event Hubs

Data Catalog

Data Factory

HDInsight (Hadoop and Spark)

Stream Analytics

Intelligence

Data Lake Analytics

Machine Learning

SQL Data Warehouse

Data Lake Store

Data Sources

Apps

Sensors and devices

Data

Big Data as part of Cortana Intelligence

*IDC study “The Business Value and TCO Advantage of Apache Hadoop in the Cloud with Microsoft Azure HDInsight”

Azure HDInsight

Hadoop and Spark as a Service on Azure

Fully-managed Hadoop and Spark for the cloud100% Open Source Hortonworks data platformClusters up and running in minutes Managed, monitored and supported by Microsoft with the industry’s best SLAFamiliar BI tools for analysis, or open source notebooks for interactive data science63% lower TCO than deploy your own Hadoop on-premises*

The Business Value and TCO of HDInsight

• 418% 5-year ROI• Four month payback period• 63% 5-year lower TCO than on-

premises• 66% staff efficiencies than on-

premises• Get it at http://aka.ms/hdinsight

*IDC study “The Business Value and TCO Advantage of Apache Hadoop in the Cloud with Microsoft Azure HDInsight”

RESOURCES ACROSS THE SALES CYCLE

© Hortonworks Inc. 2011 – 2014. All Rights Reserved

Hortonworks: Hadoop for Higher EducationSingle View of a Student

December 2016


Research Schools

One Use Case: Genome Sequencing

20,000 Genes 1,000,000,000 variables = 20 Billion Rows of Data Storage of this data is challenging – Complexities of Cancer make for

even more data Legacy platforms lack storage and processing power Distributing the data over multiple nodes changes the game


Research Schools

Hadoop, Hortonworks Data Platform and HDInsight (H3)

Gives individual researchers as much power as a team of researcher The Next Generation Cyber Capability (NGCC) architecture follows President Obama’s “National Cancer Moonshot” guidelines, with a federated framework that encourages data sharingOne query against a table with 20 billion rows would time out before it could return results. In Hadoop it returned results in 1-2 minutes


View of the Student

A single view leads to student success, satisfaction, and security:• Tailor offerings• Find opportunities for

guidance• Provide consistent student

experience• Secure campus

FinancialAid

Guidance

Teacher reported

info

Admission

CampusSecurity


Today’s Data Architectures Inhibit a Single View

1. Data Silos: disparate views of each student

2. Volume Limitations: cannot store and process all student data in the EDW

3. New Data Sources: unable to capture and use new data to complete the view

AN

ALY

TIC

SD

ATA

SYST

EMS

3

Clickstream Web & Social

Geolocation Sensor & Machine

Server Logs

Unstructured

SOU

RC

ES

RDBMS CRMCRM

Systems of Record

Enterprise Data Warehouse

1

App App

ODS

App VisualizationData Marts

2


Hortonworks Single View

Single Data Repository

• Resolve student data across repositories

• Provide administrators, teachers, counselors, and analysts with a single view of data

Optimized Storage

• Eliminate unnecessary silos to reduce costs

• Store more data about each student

Analytical Flexibility

• Dynamic schema on read removes limitations of other “single view” applications

Hor

tonw

orks

Clickstream Web & Social

Geolocation Sensor & Machine

Server Logs

Unstructured

SOU

RC

ES

Existing Systems

Admissions Finance Security

AN

ALY

TIC

S

Data Marts

Business Analytics

Visualization& Dashboards

AN

ALY

TIC

S

Applications Business Analytics

Visualization& Dashboards

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

°

HDFS (Hadoop Distributed File System)

YARN: Data Operating System

Interactive Real-TimeBatch SearchBatch BatchMPP

EDW


Single View Use Cases – Higher Education

AcquireNew Students

• Develop marketing campaigns based on a complete view of student activities

• Create incentives and messaging based on student patterns and real-time activity

• Modify marketing and advertising using new sources of data

RetainCurrent Students

• Personalize student services with a complete view of student activity and preferences

• Ensure a consistent student experience across all institutional facilities

• Identify “trouble” or “exceptional” students via social media to resolve issues proactively

GrowStudent Lifetime Value

• Analyze new data sources to determine the next best step in a student’s learning path

• Identify students to nurture in targeted programs

• Offer opportunities to students based on paths made by others with similar profiles


Single View Case Studies – Commercial Sector

AcquireNew Customers

A digital media company improves online ad placement for major retailers by combining new data sources for a single view of online behavior.

RetainCurrent Customers

A major retailer combines customer detail across systems to improve personalization, raise the customer experience, and increase customer loyalty.

GrowCustomer Lifetime Value

A major telco infers demographics in family accounts to gain a clearer picture of the entire account and identify cross-sell and up-sell opportunities.


Will I Benefit from a Single View?

• How many systems house student data in your environment?

• Are you able to bring together student data into a single view?

• Are you applying new data sources (clickstream, geolocation, social) to gain a more complete picture of students?

• Do different business units handle student data separately?

• Do students complain about an inconsistent experience?

• How do your admission and retention rates compare to your competition?

FinancialAid

Guidance

Teacher reported

info

Admission

CampusSecurity


Thank You

how universities use big data to transform education

Technology