SQL Server 2019, Containers & Linux

Eric Bortei-Doku

Program Manager (Cloud + AI)

Optimize your hybrid data estate

SQL

Optimize your hybrid data estate

The evolution of SQL Server

SQL Server 2008

SQL Server 2008 R2

SQL Server 2012

SQL Server 2014

SQL Server 2016 & 2017*

Transparent DB encryption

PowerPivot ● SharePoint integration ● Master Data Services

AlwaysOn ● In-Memory ColumnStore ● Data quality services ● Power View ● Cloud

In-memory across workloads ● Performance & scale ● Hybrid cloud optimized ● HDInsight ● Cloud BI

Industry-leading performance ● End-to-end mobile BI ● AI built-in ● Choice of language & platform ● Easy migration to the cloud

SQL Server 2019

Intelligence over all data ● Big data clusters with Spark and HDFS ● R and Python built-in ● Data classification & compliance tracking ● Azure Data Studio

*Support for Linux and Docker first available in SQL Server 2017

Agenda

Mission critical performance

Security and compliance

Developer and DBA tools

Operating system choices

Intelligence over all data

1

2

3

4

5

Security and

compliance

Developer and

DBA tools

Choice across OS

and containers

Intelligence over

all data

SQL Server 2019What’s new?

Mission-critical

performance

SQL Server 2019

Mission-critical

performance

#1 OLTP performance

#1 DW performance on 1TB, 10TB, and 30TB

#1 OLTP price/performance

#1 DW price/performance on 1TB, 10TB, and 30TB

Industry-leading, mission-critical performance

Now with higher concurrency and scale through

HW innovations including persistent memory

support NEW

Persistent memory can offer a query

performance boost of up to 30% for I/O intensive

workloads (Hybrid Buffer Pool)

Combine in-memory technologies for analytics

on your operational data using HTAP

Mission-critical performance

The intelligent database

Accelerate parallel queries and improve scaling

of frequent queries with enhanced Intelligent

Query Processing NEW

Gain performance insights anytime and

anywhere with Lightweight Query Profiling NEW

Table Variable Deferred Compilation provides

50%+ faster query execution through improved

query plans NEW

Bold indicates new and improved features in SQL Server 2019

The Intelligent Query Processing feature family

Intelligent QP

Adaptive Joins

Batch Mode

Interleaved

Execution

Memory Grant

Feedback

Row ModeBatch Mode

Approximate

Count Distinct

Mission-critical performance

Adaptive QP

Table Variable

Deferred

Compilation

Approximate

QP

Batch Mode

for Row Store

Scalar UDF

inlining

SQL Server 2019

Mission-critical

performance

SQL Server 2019

Security and

compliance

Data classification and assessments

Classification tool allows you to tag

columns stored in a SQL Server

database with pre-defined set of GDPR-

related labels

Data Classification and auditing built-

in to the engine NEW

Get visibility into your security state and

meet compliance standards with SQL

Server Vulnerability Assessment

Security and compliance

SQL Server 2019

Security and

compliance

SQL Server 2019

Developer and

DBA tools

Modern editor experience independent of OS and data sources

Azure Data Studio (formerly SQL Operations

Studio) is a lightweight, open source, cross-

platform graphical management tool and

code editor NEW

Support across Windows, Linux and MacOS

for SQL Server, Azure SQL Database, Azure

SQL Data Warehouse, and SQL Server 2019

big data

Use SQL Server Management Studio 18.0

to access, configure, manage, and administer

all SQL Server components NEW

Developer and DBA tools

Enhancing the developer experience

Build new types of apps through

extended Java language supportNEW

Enhanced graph support enables

new query types including edge

constraints and merge DMLNEW

Leverage native support for UTF-8

character encodingNEW

Launch pad

SQL

Developer and DBA tools

SQL Server 2019

Developer and

DBA tools

SQL Server 2019

Choice across OS

and containers

More deployment choices than ever before

Support for Red Hat Enterprise Linux,

SUSE Linux Enterprise Server, Ubuntu,

and Windows

Linux and Windows Docker containers

SQL Server in Red Hat containers NEW

Linux-native installation: Yum Install, Apt-Get

Application and database compatibility

Replication, DTC, and Machine Learning in

SQL Server 2019 NEW

Choice across OS and containers

SQL Platform Abstraction Layer

(SQLPAL)

RDBMS IS AS RS

Windows Linux

Windows Host Ext. Linux Host Extension

SQL Platform Abstraction Layer(SQLPAL)

Host extension mapping to OS system calls(IO, Memory, CPU scheduling)

Win32-like APIsSQL OS API

SQL OS v2

All other systemsSystem resource &

latency sensitive code paths

Platform abstraction layer - SQL Server on Linux

Choice across OS and containers

VM 1 VM 2

Containers – High Level Overview

Host OS

Hypervisor

Guest OS Guest OS

Bins / Libs

Application

Bins / Libs

Application

Host OS

Container 1 Container 2

Bins / Libs

Application

Bins / Libs

Application

Container Engine

Shared storage HA in Kubernetes on SQL Server

Persistent Volume Storage

User

Node

Pod

SQL Server

Node

Load Balancer Service

Node

Pod

SQL Server

Pod

SQL Server

Choice across OS and containers

Mission critical availability

Use Availability groups on

Kubernetes to implement a full

AG system integrated into SQL

Server NEW

Accelerated Database

Recovery performs versioning

to ensure recovery and

availability of data NEW

Objects outside the database

can now automatically failover,

avoiding the need for custom

data replicationsA

G

Pod

Operator

Pod

SQL Server

primary

AG agent

Load

balancer

Pod

SQL Server

secondary

AG agent

Pod

SQL Server

secondary

AG agent

SQL Server

primary

SQL Server

secondary

Load

balancer

SQL Server 2019

Choice across OS

and containers

SQL Server 2019

Intelligence over

all data

SQL Server 2019 enables intelligence over all your data

Build intelligent apps and

AI with all your data

AI over all data

Easily and securely manage

data big and small

Managing all data

Simplified management and analysis through a unified deployment, governance, and tooling

Unified access to all your data with

unparalleled performance

Integrating all data

Intelligence over all data

SQL Server 2019 big data, analytics, and AI

Managed data lake with

SQL Server and Spark

SQL Server

Data virtualization

T-SQLAnalytics Apps

Open

database

connectivity

NoSQL Relational

databases

HDFS

Complete AI platform

SQL Server External Tables

Compute pools and data pools

Spark

Scalable, shared storage (HDFS)

External

data sources

Admin portal and management services

Integrated AD-based security

SQL Server

ML Services

Spark &

Spark ML

HDFS

REST API containers

for models

Managing all dataIntegrating all data AI over all data

Store high volume data in a data lake and access it

easily using either SQL or Spark

Management services, admin portal, and

integrated security make it all easy to manage

Combine data from many sources without moving

or replicating it

Scale out compute and caching to boost

performance

Easily feed integrated data from many sources to

your model training

Ingest and prep data and then train, store, and

operationalize your models all in one system

Intelligence over all data

Data virtualization easily combines data from many sources and eliminates data silos

Intelligence over all data

SQL Server

T-SQLAnalytics Apps

NoSQL Relational databases Big data

PolyBase external tables

SQL Server is the hub for integrating data

Easily combine across relational and

non-relational data stores

Intelligence over all data

Data virtualization creates solutions

CostsLower storage costs

Less dev time spent on integration

Rapid iterations and prototypes

Timely data

Smaller attack surface area

Consistent security model

Fresh and accurate data

Easier data governance

Speed

Security

Quality

Compliance

Data virtualization integrates data from

disparate sources, locations and formats,

without replicating or moving the data, to

create a single "virtual" data fabric

Intelligence over all data

SQL Server simplifies big data deployment, operation, and integration

Intelligence over all data

Deploy and manage a SQL Server + big data cluster

Easily deploy and manage a big data cluster using

Microsoft’s Kubernetes-based big data solution

built-in to SQL Server

Hadoop Distributed File System (HDFS) storage,

SQL Server relational engine, and Spark analytics

are deployed as containers on Kubernetes in one

easy-to-manage package

Intelligence over all data

SQL Server

master instance

Persistent storage

Custom apps AnalyticsBI

SQL

Server

HDFS Data Node

Spark

Kubernetes pod

SQL

Server

HDFS Data Node

SparkSQL

Server

HDFS Data Node

Spark

Node Node Node

Scale out big data compute and storage

SQL Server 2019 includes Spark and HDFS,

enabling you to read and write directly in HDFS

using SQL Server or Spark NEW

Elastically scale compute and storage on demand

using the Kubernetes architecture NEW

Apps, BI, and analytics access all your relational

and big data through the SQL Server master

instance using T-SQL NEW

Scale-out data marts combine and cache data

from relational and non-relational data sources

for fast querying NEW

SQL

Intelligence over all data

Increase analytics and apps performance

Compute pool

SQL Compute

Node

SQL Compute

Node

SQL Compute

Node…

Compute pool

SQL Compute

Node

IoT data

Directly

read from

HDFS

Persistent storage

…

Storage pool

SQL

ServerSpark

HDFS Data Node

SQL

ServerSpark

HDFS Data Node

SQL

ServerSpark

HDFS Data Node

Kubernetes pod

AnalyticsCustom

apps BI

SQL Server

master instance

Node Node Node Node Node Node Node

SQL

Data pool

SQL Data

Node

SQL Data

Node

Compute pool

SQL Compute

Node

Storage Storage

Intelligence over all data

Resources

Intelligence over all data

What’s New in SQL Server 2019TPC OrganizationKubernetesRed Hat ContainersSQL Server Workshops