couchbase chennai meetup #3 what's new in couchbase server & couchbase mobile

What is new in Couchbase Server 4.6 DP& Couchbase Mobile 1.3

Karthik Babu SekarSolutionsArchitect,WWFieldOperations@Couchbase

- LinkedIn - https://www.linkedin.com/in/karthikbabusekar- Twitter- https://twitter.com/SKBhere

- E-mail – karthik@couchbase.com

Agenda

- History- Couchbase Defined- Journey.. So far- What’s new in Couchbase Server 4.0 ?- How about Couchbase Server 4.5 GA ?- What’s exciting in Couchbase Server 4.6 DP ?- What else is new ?- What about Couchbase Mobile 1.3 GA?

HistoryofCouchbase

CouchbaseDefined

First NoSQL Database to have a multi-model NoSQL Server & NoSQL Mobile Database Solution

Managed Cache Key-Value Store Document Database Embedded Database Sync Management

DevelopwithAgility

With Couchbase Server, you can Develop Applications with Agility. Here’s why:

Easier, Faster Development Flexible Data Modeling Powerful Querying

SQL Integration & Migration Big Data Integration Mobile / IoT

OperateatAnyScale

With Couchbase Server, you can deploy, manage, and scale apps without limits. Here’s why:

Elastic Scalability Consistent High Performance Always-on Availability

Multi-Data Center Deployment Simple, Powerful Administration Enterprise Grade Security

TheJourneythusFar

FocusedonTechnicalInnovation

CouchbaseServer1.8

HighScaleKey/ValueDatabase

CouchbaseMobile1.0OfflineDataAvailabilityAuto-synchronization

CouchbaseServer3.0

Mission-CriticalScale&PerformanceSimplifiedAdministrationImprovedHA/DR&Security

CouchbaseServer4.0SQL-likeQuerieswithNewSecondaryIndexing

Multi-DimensionalScalingArchitectureImprovedSecurity

CouchbaseServer2.0DocumentExtensions

NewXDCR

CouchbaseServer2.1EnhancedSecurity

HA/DR

CouchbaseServer2.2ImprovedXDCR

AdvancedStorageEngine

What’snewin4.0

▪ CouchbaseServer4.0– QueryandIndexing:• N1QLandNewGlobalSecondaryIndexing

– EnhancedClusterManagement• NewClusterZoneswithMulti-dimensionalScaling(MDS)

– EnhancedIntegrations• NewODBC/JDBCDriverswithconnectivitytoETLandBITools• NewNative,SparkStreaming,SparkSQLandKafkaIntegration

– EnhancedSecurity• AuditingandEnterpriseLDAPIntegration

– EnhancedHighAvailability• FasterXDCRandFilteringXDCR

CouchbaseServerArchitecture

Overview

Service-BasedArchitecture

Multi-Dimensional Scalability (MDS) – Optionally Scale each service independently:• Data• Index• Query

MDS is the architecture that enables independent

scaling of data, query, and indexing workloads while

being managed as one cluster.

©2015CouchbaseInc. 11

CouchbaseDataAccess

• Everything is built on top of Key Value

• A Document store is a special case of Key-Value

• Views provide aggregation and real-time analytics through incremental map-reduce

• Global Secondary Indexes provide low latency/high throughput indexes

• N1QL is a language that provides a powerful and expressive way of accessing documents

What’sNewin4.5GA

©2015CouchbaseInc. 13

Couchbase4.5- KeyFeatures

• Integratedqueryworkbenchwithauto-schemainference• ExtendedJOINsyntax• Integratedfull-textsearchqueries[preview]

EASIER,MOREEFFICIENTQUERYING

• EfficientRead/Writeofdatastructureswithsub-documentAPI• Fasterread-your-own-write(RYOW)consistencywithN1QLqueries

SIMPLER,MOREADVANCEDDATAACCESS

• FasterIndexingwithMemory-optimizedindexes• ArrayindexingforfasterN1QLqueriesonarraysinJSON• ImprovedindexwriteperformancewithForestDB’scircularwrites

FASTER,MOREPOWERFULINDEXING

• Role-based-accesscontrolforadministrators&X.509certificatesforencryptedcommunication• Queryprofilingandmonitoring• Fasterbackupandrestore

BETTER,MORECOMPREHENSIVEADMINISTRATION

©2015CouchbaseInc. 14

SimplifiedDevelopment

QueryWorkbenchwithAutoCompleteforN1QL

NewIntegratedN1QLQueryWorkbenchTool(QWT)

N1QLEditorwithAuto-Completion&QueryHistory

DataWindowwithVisualTable,TreeandJSONOutput

BucketAnalyzerwithSmartSchemaInference

AutomaticSchemaInferenceandAuto-Completion

▪ SmartSchemaInference:Automaticallyexaminessampleofdocumentsfrombucketsanddiscoversyourschema– DocumentTypeDistribution– ListofAttributes– DataTypesforAttributes

BucketAnalyzerinWebConsole CBQCommandlineShell

Auto-CompletewithQueryEditor

▪ Auto-CompletioninN1QLeditorprovides– MatchingN1QLKeywords– FieldNamesfromInferredSchema– Addbackquotesfornameswithhyphen

NewFlexibleJOINswithN1QL

7XfasterquerywithflexibleJOIN

Full-textSearchService[DeveloperPreview]

SearchtextdatainyourCouchbasedocuments▪ Powersearchboxesfordocumentcontents,websites,blogposts,Tweets,ticketingandcatalogapps

Full-textSearchService[DeveloperPreview]

▪ Benefits– Fullycapablesearchservice,integratedinCouchbase– ImmediatelyfamiliartousersofElasticsearch andSolr– Couchbaseadministrationandmanagement• Automaticallypartitioned,distributedandreplicated

– Noexternalsearchdependencies• Noneedtoprovisionhostsandinstallextrasoftware• Avoiddatatransfersetupandsyncmanagement

Full-textSearchService[DeveloperPreview]

▪ FullRangeofTextQueriesSupported– Basic• Match,MatchPhrase,Fuzzy,Prefix,Regexp,Wildcard,BooleanField

– Compound• QueryString,Boolean,Conjunction,Disjunction

– Range• DateRange,NumericRange

– SpecialPurpose• DocIDQuery,MatchAll,MatchNone,Phrase,Term

▪ Plusscoring(TF/IDF),boosting,fieldscoping,highlighting,andmore

©2015CouchbaseInc. 22

ImprovedPerformanceandScale

EfficientSub-DocumentOperations

DocumentMutations:• AtomicOperateonindividual

fields• Identicalsyntaxbehaviorto

regularbucketmethods(upsert,insert,get,replace)

• SupportforJSONfragments.• SupportforArrayswith

uniquenessguaranteesandordinalplacement(front/back)

FasterKeyBasedOperations!

10-14XFasterDocumentRead&UpdateOperation95%GetLatency 95%SetLatency

95%Get&SetLatencyMeasured(Msecs)onsingleINTfieldupdatewithsub-documentvsfull-documentcall

GlobalSecondaryIndexes

NewStorageOptionsforGlobalSecondaryIndex1. Memory-OptimizedGlobalSecondaryIndexes(MOI)

• OptimizedforMemory:smallmemoryfootprint,optimizedforlowestlatencyqueries• FasterIndexing:freshindexesunderheavymutationswithlockfreeindexmaintenance• PredictablelowlatencywithQueryandKeyBasedOperations,eveninpresenceoflarge

numberofindexes

1. StandardGlobalSecondaryIndexes• OptimizedforStorage+Memory:efficientspilltodiskwithForestDBasthestorage

engine• AdvancedIOPerformance: newcircularwritesthatminimizecompactionoverheadof

appendonlywrites

EfficientIOwithCircularWritesinStandardGSI

▪ ReducedDiskIORequirements– Append-OnlyWriteswithfrequentfullcompaction(Version4.1&Earlier)– Circular-ReuseWriteswithreducedfullcompactions(Newin4.5:)• Reusedorphanedblocksintheindexfile• Reducetheneedforfrequentfull-compactionsoftheindexfile

IndexMutation

Append-OnlyWriteCircularWrite

FileforGlobalSecondaryIndexes

IndexMutation

IndexMutation

ArrayIndexes-- FasterSearchforNestedData

▪ EfficientlyIndexArraysCREATE INDEX …

ON bucket(ARRAY i FOR i IN b END, a)

USING GSI;

▪ SampleQueriesSELECT * FROM default

WHERE ANY i IN b SATISFIES i<=1 END;

SELECT * FROM default X

UNNEST X.b Y

WHERE y<=1;

insertintodefault(key,value)values("1",

{"a":1,"b":[1,2],"c":{"ca":[1,2,3],"cb":4},"d":[

{"da":5,"db":6,“dc”:6.5},{"da":7,"db":8}],

"e":[{"ea":9,"eb":[10,11,12]},{"ea":13,"eb":[14,15,16]}],

"f":[[17,18],[19,20,21]]

});

EnterpriseBackupandRestore

>10xFasterBackups

▪ BetterDataProtectionwithEnterpriseBackupRestore– Scaletolargerdatasets– Fastbackupsandrestores– BetterConsistencyinbackupdata– Resilienttofailures/TopologyChanges

©2015CouchbaseInc. 29

SimplifiedSecurityCompliance

AdministrativeRoleBasedAccessControl

▪ AdministrativeRBACenablessegregationofadminduties▪ Administrativeuserscanbemappedtoout-of-the-boxroles▪ Separationofsecurityadministrationfromfulladministration▪ Rolespre-definedwithpermissionsforspecificresources

– FullAdmin– ClusterAdmin– BucketAdmin– ViewAdmin– XDCRAdmin

FullAdmin

ClusterAdminBucketAdminViewAdminXDCRAdmin

X.509Client-ServerCertificates▪ Bring-Your-OwnCertificateAuthority

– SupportforcommerciallyandinternallyissuedX.509certificates▪ StronglyCAtrustedon-the-wireencryptionforapplicationsandbetweendata-centers(XDCR)

▪ Simplifiedcertificatemanagementandrotation

Couchbase&Containers

▪ CouchbaseServeronDockerandOrchestrationTechnologies▪ OfficialDockerSupportwithMacOS,Ubuntuiscoming

PlatformasaService

CouchbaserunsonPaaSenvironments

CurrentFocus FuturePlan

What’sNewin4.6DP?

Disclaimer

Couchbase Server 4.6 is current a Developer Preview release and is intended for development purposes only.We consider Developer Preview releases to have some rough edges and bugs, and may change significantlybefore the final GA release. This release is not supported in production. The Developer Preview releasedoes not support upgrading from an earlier version of Couchbase Server.

©2016CouchbaseInc.

What exciting in 4.6 DP?

• Cross Datacenter Replication– Cross Datacenter Replication with Timestamp-based Conflict Resolution

• Security– Hardened Security with Pluggable Authentication Module

• New Functions in N1QL– N1QL introduces a number of new string and date functions in this release

• Full Text Search– Faster Full Text Indexing and Queries – Index Mapping & Sorting

• Tools– cbimport imports data from a CSV file or a JSON document, and cbexport exports data as a

JSON document

Mobile

Search

CacheOLAP

Data Warehouse

Hadoop

RDBMS

Whatelseisnew?

©2015CouchbaseInc. 38

Search

OLAP

Data Warehouse

Hadoop

{N1QL}

Whatelseisnew?

©2016CouchbaseInc.

Search

OLAP

Data Warehouse

Hadoop

{N1QL}

©2016CouchbaseInc.

OLAP

Data Warehouse

Hadoop

{N1QL}

©2016CouchbaseInc.

FULL TEXT SEARCH

Structured Query AND SearchOne platform.

|

Search Feelinglucky?

©2016CouchbaseInc.

OLAP

Data Warehouse

Hadoop

{N1QL}

©2016CouchbaseInc.

OLAP

Data Warehouse

Hadoop

{N1QL}

©2016CouchbaseInc.

Data Warehouse

Hadoop

{N1QL}

©2016CouchbaseInc.

Data Warehouse

Hadoop

{N1QL}

©2016CouchbaseInc.

INTRODUCING REALTIME ANALYTICS

You may also like these products

Thank you for your order!Order #: 3423943

Paid Partner Content

Operations & Analytics. One platform.

©2016CouchbaseInc.

Data Warehouse

Hadoop

THE PLATFORM FOR YOUR DIGITAL APPLICATIONS

©2016CouchbaseInc.

THE DATA PLATFORM FOR THE DIGITAL ECONOMY

UNIFIED ADMINISTRATION

UNIFIED PROGRAMMING INTERFACE

Data Query Index SearchMobileReplication Analytics

{N1QL}

©2016CouchbaseInc.

Why Couchbase Analytics ?

• Common data model: Couchbase Analytics natively supports the same rich, flexible-schema document data model used in Couchbase Server, rather than trying to force your data into an RDBMS model.

• Workload isolation: Operational query latency and throughput are protected from slow downs due to analytical query workload - without the complexity of operating a separate analytical database.

• High data freshness: Couchbase Analytics uses DCP, a fast memory-to-memory protocol that Couchbase Server nodes use to synchronize data among themselves. Because of this, analytics run on data that’s extremely current, without extract, transform, load (ETL) or other hassles and delays.

©2016CouchbaseInc.

What’s new in Couchbase Mobile 1.3 GA?Couchbase Mobile is the complete NoSQL database solution for all data storage, access, sync, and security across the entire application stack.

Support for OpenID Connect• Log in to Sync Gateway using a third-party identity provider• Authenticate users with providers that implement OpenID Connect (e.g. Google+, PayPal, Yahoo, Active Directory,

etc.)

Document Expiration (TTL)• Give documents in your local database an expiration time• Automatically clean up your database for short-lived documents

SG Replicate• Integrated support for Sync Gateway-to-Sync Gateway replication• Allows deployment configurations for tree and other non-star topologies

SGCollect Info• Get detailed statistics for Sync Gateway with the new command line utility called sgcollect_info

50

©2016CouchbaseInc. 51

Replication

SG-Replicate XDCR

• ReplicateviaREST/HTTP• Master/MasterorMaster/Slave• FineGrainDataReplicationvichannel(s)• ReplicationofflineforyearsisOK.

• ReplicateviaMemorytoMemory• Master/MasterorMaster/Slave• FullDataCopy/FilteredXDCR• ReplicationOfflineforfewdaysisOK.

Thankyou