microsoft sql server flash storage

19
FLASH STORAGE FOR SQL SERVER FLASH STORAGE FOR SQL SERVER Speaker: Sumeet Bansal Fusionio San Francisco SQL Server User Group San Francisco SQL Server User Group March 2011 Mark Ginnebaugh User Group Leader Mark Ginnebaugh, User Group Leader , [email protected]

Upload: mark-ginnebaugh

Post on 29-Nov-2014

2.272 views

Category:

Business


1 download

DESCRIPTION

Sumeet Bansal of Fusion-io defines a "Dream Database Architecture. You'll Learn:* If Flash Storage is right for your organization* How to set up for High Availability* What's coming next in Solid State StorageLastly, you'll hear how software manufacturers are responding to the distributed architecture trend, including validation from leaders such as Microsoft and Oracle.

TRANSCRIPT

Page 1: Microsoft SQL Server Flash Storage

FLASH STORAGE FOR SQL SERVERFLASH STORAGE FOR SQL SERVER

Speaker: Sumeet BansalFusion‐io

San Francisco SQL Server User GroupSan Francisco SQL Server User GroupMarch 2011

Mark Ginnebaugh User Group LeaderMark Ginnebaugh, User Group Leader, [email protected]

Page 2: Microsoft SQL Server Flash Storage

Flash storage: Is it right for you?

Sumeet Bansal Principal Solutions Architect, Fusion-io

March 9, 2011 Microsoft Office San Francisco

Page 3: Microsoft SQL Server Flash Storage

Who am I?

Until June 2009

• Vice President of IT & DBA at Wine.com

• Served at Wine.com for a decade

• Introduced Fusion-io at Wine.com in Late 2008

NNow

• Principal Solutions Architect at Fusion-io

• Evangelize through presentations demos webinars etc• Evangelize through presentations, demos, webinars etc

• Help Clients discover ways of maximizing efficiency and performance and at the same time cutting costs

• Still a huge fan of Wine.com

Page 4: Microsoft SQL Server Flash Storage

Dream Database Architecture (DDA)

DDA impliesDDA implies

• High Performance

• High Availabilityg y

• Easy to Manage

• Energy Efficient

• Cost Effective

Page 5: Microsoft SQL Server Flash Storage

Dream Database Architecture (DDA)

SAN

ioMemory is core of DDAioMemory is core of DDA

ioMemoryL1, L2 & L3CPU Cache

DRAM

Mill isecond (10E-3)Nanosecond (10E-9) ACCESS DELAY IN TIME

Page 6: Microsoft SQL Server Flash Storage

What is possible – Wine.com

Metric Pre Fusion-io Post Fusion-io Improvement “Boost” Customer Facing Improvement

Average duration of a SQL transaction

345 milliseconds 88 milliseconds 300% 4 Times Website pages faster, each page has multiple DB requests. Reducing Time fetching data improves customer experience, leads to better conversion.

Time taken to take a full backup of the largest database

Time taken to restore a full backup of the largest d t b

2 hours

3 hours

6 minutes

15 minutes

1900%

1100%

20 Times

12 Times

During backups, customer experience is no longer hindered.

Faster time to recovery, less loss exposure in major downtime.

database

Average number of read/write operations waiting in a queue to complete

0.4 0.008 4900% 50 Times Less time for customer to wait on another customers long running operation.

Number of transactions in 1 hour window that took more than 500 milliseconds

3011 163 1700% 18 Times Website pages faster, each page has multiple DB requests. Reducing Time fetching data improves customer experience, leads to better conversion. More cart transactions per second.

Page 7: Microsoft SQL Server Flash Storage

What is possible - Wine.com

Business Value Gained

• 50x fewer average transactions in queue• Decreased Cart Abandonment and increased revenue by at least 2%.

• Reduced daily backup window from 2 hrs down to 6 minutes• Gained extra revenue for a 2 hour duration every day of the year.• If avg. 2 hour revenue gained (off peak hours) is $2K, the total revenue

gain per year is $730Kgain per year is $730K

• Year End invoices posted in a single day that used to take 1 month• Books closed faster than ever.

• Zero database blocking with rollbacks• Saved considerable time in warehouse and finance with no lost

inventory, duplicate inventory purchasing, and tedious research / reportingreporting

Page 8: Microsoft SQL Server Flash Storage

Measuring performance on Fusion-io

Try to measure application performance

• Use profiler to track average SQL transaction completion time• Use perfmon to track various aspects:

– Logical Disk:Disk Reads/sec (Read IOPS)– Logical Disk:Disk Writes/sec (Write IOPS)– Logical Disk:Disk Reads Bytes/sec (Read Throughput)– Logical Disk:Disk Writes Bytes/sec (Write Throughput)– Logical Disk:Avg Disk Sec/Read (Read Latency)

Logical Disk:Avg Disk Sec/Write (Write Latency)– Logical Disk:Avg Disk Sec/Write (Write Latency)– Use the Physical disk object if need to track on disk level in a

RAID configuration

Page 9: Microsoft SQL Server Flash Storage

Measuring performance on Fusion-io

Following are some suggested tests on a non-production environment

• Perform maintenance tasks like backup/restore/rebuild of indexes• Use multiple connections simultaneously to read or write to a table• Run most frequently executed stored procedures and time them• Measure latency in an active High Availability scenario like Database

MirroringMirroring

Page 10: Microsoft SQL Server Flash Storage

Addressing High Availability

• Database Mirroringg• Synchronous• Asynchronous

• Multi-site clusteringMulti site clustering• Requires Windows 2008 R2• Requires a third-party data replication software

– Data Keeper by Steel Eye TechnologiesData Keeper by Steel Eye Technologies– Double-take

• SQL Server replication• Specific to certain environmentsSpecific to certain environments• Works on Database Object level

Page 11: Microsoft SQL Server Flash Storage

Addressing High Availability

• Neverfail• http://www.neverfailgroup.com/windows-apps/sql-server-high-

availability.html

• Marathon• http://www.marathontechnologies.com/sql-high-

availability.html

Page 12: Microsoft SQL Server Flash Storage

Mirroring vs. Clustering

Mirroring Clusteringg• Provides protection against data corruption

(page level corruption) because there are two separate physical data stores.

• Starting from SQL Server 2008, the system

g• Does not protect against data corruption

because there is a single data store on the shared storage.

• One has to either restore from a backup g yautomatically fixes corrupt pages (in enterprise edition)

• Mirror failover can be completely automated

por run a dbcc repair command with allow for data loss option

• Both options will result in data loss

using a witness server• Starting from SQL Server 2008, the transaction

logs for mirroring are compressed before sending to the mirror. So much better network utilizationutilization

Page 13: Microsoft SQL Server Flash Storage

Mirroring vs. Clustering

Mirroring Clusteringg• Ordinarily, the databases on the mirror server

are not readable. However, if enterprise edition is present, one can create read-only snapshots on the mirror server

g• Reading from a separate node, without

impacting the primary is not possible

• The snapshot creation is a sub-second operation regardless of the size of the database

• The snapshot can be dropped and t d t i t l ( 5 recreated at an interval (say every 5

minutes) to keep up with the data• This helps to gain better value from the

mirroring server

Page 14: Microsoft SQL Server Flash Storage

Mirroring really is better

• Mirroring is fast• Mirroring is fast

• Mirroring allows for a distributed architecture

• Shared storage is not really geared for performance, it is geared for capacity

• A different architecture (Distributed) is needed to drive performance

Page 15: Microsoft SQL Server Flash Storage

Validation

• IBM HP and DELL are OEMs and expanding on relationships• IBM, HP, and DELL are OEMs and expanding on relationships

• Microsoft: SQL Server 2011 (Denali)• Will provide clustering options without requiring shared storage• There will be multiple mirrors per server possible

• Oracle• Flashcache• Dataguard with complete automatic failover

Page 16: Microsoft SQL Server Flash Storage

Sneak Peek

• DirectCache• DirectCache• Use ioMemory as cache• Automatic Data management• Increase performance and economize on existing SAN infrastructureIncrease performance and economize on existing SAN infrastructure• Will support Clustered environments too

Page 17: Microsoft SQL Server Flash Storage

DirectCache

SAN

ioMemoryL1, L2 & L3CPU Cache

DRAM

Mill isecond (10E-3)Nanosecond (10E-9) ACCESS DELAY IN TIME

Page 18: Microsoft SQL Server Flash Storage

T H A N K Y O U

Page 19: Microsoft SQL Server Flash Storage

To learn more or inquire about speaking opportunities, please contact:o ea o e o qu e about spea g oppo tu t es, p ease co tact:

Mark Ginnebaugh, User Group [email protected]