partner webcast – solving the internet of things scalability challenge with oracle data management...
TRANSCRIPT
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Solving the IoT Scalability Challenge with Oracle Data Management Solutions Using Oracle NoSQL Database, Berkeley DB & Database Mobile Server
2
Michael Brey Director Development, Oracle
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Safe Harbor Statement
The following is intended to outline our general product direction. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. The development, release, and timing of any features or functionality described for Oracle’s products remains at the sole discretion of Oracle.
3
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Agenda
The IoT Scalability Challenge
Use Cases & Solution Architecture
Oracle NoSQL Database
Database Mobile Server
Demonstration
Summary & QA
4
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
IoT Drivers
1. The four V’s of Big Data
– More Data, More Queries, Low Latency Operations (SLAs) Driving Business Innovation
2. Cost of Operations.
– Cost effective horizontally scalable simple operations on simple data, Requires less HW, Lower license costs than traditional RDBMS databases Lower TCO
3. Time to Market
– Developer-centric Data Management, Data Variety, Rapid Evolution Shorter Time to Market
– Scalable, reliable, secure solutions that adapt to evolving business requirements A Platform for Today and the Future
5
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
IoT Business
• IDC predicts that the total number of “Connectable Things” will exceed 200 Billion by 2020.
• Gartner estimates the total economic value-add from the Internet of Things across industries will reach US$1.9 trillion worldwide in 2020.
• Today 11 percent of all data is machine-generated. IDC estimates that by 2020, the number will rise to 40 percent, with somewhere between 20 and 50 billion devices fueling that growth.
• You need to acquire and manage the data, integrate and secure the data, and finally analyze and act on the data.
6
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Agenda
The IoT Scalability Challenge
Use Cases & Solution Architecture
Oracle NoSQL Database
Database Mobile Server
Demonstration
Summary & QA
7
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Use Case: Fleet Data Management
8
Objectives
Solution
Benefits
Thousands to millions of vehicles
Multi-purpose data collection
Reliable, secure data capture
Intermittent network connectivity
Berkeley DB in the vehicle to store data
locally
Database Mobile Server for syncing data
Oracle NoSQL Database for scalable data
storage and analysis
Cost effective, scalable storage
Secure, scalable and reliable data sync
Handles connected/disconnected modes
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Use Case: 2-Tier Sensor Data Capture
9
Objectives
Solution
Benefits
Millions of devices
Simple, scalable data relay
Scalable, secure data capture
Low latency storage and query
Simple, internet capable devices
Database Mobile Server for syncing data
Oracle NoSQL Database for scalable data
storage and analysis
Cost effective, scalable storage
Secure, scalable, reliable data capture
Flexible, evolvable architecture
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Use Case: 3-Tier Sensor Data Capture
10
Objectives
Solution
Benefits
Millions of devices
Intelligent data channel
Scalable, secure data capture
Intermittent network connectivity
Low latency storage and query
Simple, internet capable devices
Berkeley DB in the gateway
Database Mobile Server for syncing data
Oracle NoSQL Database for scalable data
storage and analysis
Cost effective, scalable storage
Secure, scalable, reliable data capture
Smart, extensible middle-tier
Flexible, evolvable architecture
Handles connected/disconnected modes
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
DMS Sync Client
User Application
High Level Solution Architecture Oracle NoSQL Database & Database Mobile Server queue-based publication
11
Storage Nodes Datacenter A
Application
NoSQL DB Driver
Application
Client
App Server - WLS
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Agenda
The IoT Scalability Challenge
Use Cases & Solution Architecture
Oracle NoSQL Database
Database Mobile Server
Demonstration
Summary & QA
12
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Web-Scale Personalization & Xaction Processing • Direct-to-Consumer web services
• Real-time transaction capture
• High volume, Low latency
• Retail, Telco, Financial Svcs, Insurance
Time Series & Sensor Data Mgmt • Efficient, scalable data persistence
• Requires analytics and visualization
• Scalability, Cost management
• Utilities, Oil & Gas, Manufacturing, Financial Svcs
Real Time Event Processing • Scalable container for rules and history
• Provides context to interpret events
• Low latency, Cost trade-offs
• Credit Card Svcs, Content Recommend Engines, Telco
Aggregation & Consolidation • Disparate data sources, integrated data
• Customer Service, 360 View
• Business Innovation from legacy systems
• Insurance, Banking, Telco, Healthcare, Entertainment
Common NoSQL Use Cases
13
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Finance
• Large credit card network provider
• Fraud rule and history management
• 6,500 ops/sec, 85% update on read
Manufacturing
• Large airline manufacturer
• Developing next generation planes
• 750K key inserts/sec, 6TB/hour
Telecoms
• Large mobile telecom operator
• Mobile personalized advertizing
• 24,000 ops/sec, 100% update on read
Customer Loyalty
• Operationalize analytics to NoSQL Customer Portal
• Optimized operational load balancing
• 20M+ customers in multiple countries
Oracle NoSQL Database customer success…
……many more
14
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
What is Oracle NoSQL Database
15
101100101001001001101010101011100101010100100101
Reliable Flexible Fast Simple
advanced Key-Value NoSQL database designed as cost effective, high performance solution for simple operations on collections of simple data with built in high
availability and elastic scale-out.
less is more
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Oracle NoSQL Database NoSQL for Developers and IT
16
Setup, Admin, API & Integration
Built-in HA, Predictable Performance
Parallel Access & Scale-out
Simple:
Fast:
Flexible:
Reliable:
Flexible schema & Agile development
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
• Common NoSQL Features
– Elastic
– BASE Operations
– Tables / JSON / Binary
– Online management
• Differentiators
– ACID transactions
– Online rolling upgrades
– Streaming large object support
– Oracle technology integrated
– Engineered Systems and Commodity HW
Oracle NoSQL Database Overview
17
Application
Storage Nodes Datacenter B
Storage Nodes Datacenter A
Application
NoSQL DB Driver
Application
NoSQL DB Driver
Application – Data Center Support
– Secondary Indexes
– Secure Access
– Flexible schema
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
• Query NoSQL data from Oracle Database and Hive
• Access NoSQL data from Hadoop and Spark for DW and analytics
• Share data with Oracle Coherence for extensible in-memory cache grid
• Persist history & event streams for processing with Oracle Event Processing
• Store & query RDF data using Oracle RDF for NoSQL
• Replicate changes in Oracle Database to NoSQL DB using Oracle Golden Gate
• Monitor your NoSQL cluster using Oracle Enterprise Manager
18
Integrated out of the box
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Agenda
The IoT Scalability Challenge
Use Cases & Solution Architecture
Oracle NoSQL Database
Database Mobile Server
Demonstration
Summary & QA
19
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
“Oracle DMS has made it possible to move one of our internal applications into the mobile arena. We were able to integrate online with offline activity in a user friendly manner. Our target is to service over 10,000 internal customers with this application”
Brian T. Schultz, VP HR Information Technology
“We are deeply invested in Oracle technology for all our database needs and Web applications. Oracle Database Mobile Server helped us extend our apps to our volunteers without having to worry about transaction management, security or other data-related issues in quick time.”
Anand Adkoli, Architect
"Our mFinity platform uses Oracle Database Mobile Server for its synchronization needs. The platform is now built upon the infrastructure of the Oracle Public Cloud, and relies on Oracle Database Services. With the new features in DMS 12c, along with Oracle cloud capability it is opening up new and larger IoT deployments for us.”
Daniel Pahng, mFrontiers, President
"OpenPharma is used every day by almost 1000 people across 30 networks, both in the field and at head offices. Oracle's Mobile Server engine allows OpenPharma to integrate management of all data streams between users and centralized bases. The new Mobile Server version will make it possible to extend the solution for all Nomadvantage clients equipped with the OpenPharma mobile CRM.“
Fabrice Billiotel, Lead DBA
nomadvantage
20
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. | 21
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
• DMS Purpose
– Scalable data synchronization between local client data store (BDB/JavaDB/SQLite) and Oracle RDBMS, Oracle NoSQL
– Mobile client device management
– Mobile client application management and provisioning
• Main Categories of Mobile Environments
– Mostly Connected
– Occasionally Connected
– Mostly Disconnected (no external data dependency
22
• Typical Use Cases
– Connecting data generating devices
– Remote embedded diagnostic units
– Polling data collection
– Mobile Sales Force
– Mobile Field Service
– Police/Ambulance units
– Distributed mobile retail stations
The Landscape Enterprise-grade, scalable, secure mobile application platform
• Server Side – Mostly 64-bit and some
32-bit
– Windows (7, 8, 2008, 2003)
– Linux (plus many distros)
– Solaris (SPARC and X86)
– AIX
– HPUX
• Client Side – iOS
– Android
– Windows Mobile
– Windows (Win32)
– Linux
– Blackberry
Database Mobile Server Platform Support Multi-platform support
23
Database Mobile Server Architecture
24
DMS Metadata (Oracle RDBMS)
Oracle NoSQL
Oracle RDBMS
Oracle NoSQL
HTTP
JDBC Connection
Pool
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
• BDB
– AES encryption built in
– SQL 92 compliant
– Row level locking
– High Concurrency
– Scalable to GB
– Native sequences
– Streaming BLOBS
– Full Oracle support
• SQLite
– Open source
– SQL 92 compliant
– Useful for small dbs
– Embedded in Android
– Single database file
– Limited performance knobs
– Strongest with read intensive workloads
25
• Java DB
– Oracle distribution of Apache Derby
– Included in JDKs from 1.5
– Full featured
– 3MB footprint
– Written completely in Java
– Runs inside a JVM
– Can run as embedded or client/server
The Clients Chose one based on your needs
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Oracle Database Mobile Server key differentiators – Scalability
• Additional Mobile Servers can be deployed in a server farm to handle increased client synchronization load.
– Security end to end • On-the-wire data and application network communication can be encrypted, authentication,
User/Role based access, database (server and client)
– Reliability • Mature Oracle product with more than 15 years in the market.
• Interrupted synchronization sessions resume where they left off.
– Customizability • Tailor to your unique environment.
• Supports multiple popular application development frameworks: Cordova, MAF, Titanium, mFinity, Xcode, Java, etc.
26
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
– Scalable Architecture
• Clients upload to server and download from the server using In and Out Queues
• CPU intensive operations can be queued and executed when the system is available
– Transport Independence
• Any TCP/IP enabled carrier network can be used for synchronization.
– Bi and Uni-directional Synchronization
• Upload and download of data during Synchronization.
• Synchronization can be customized to allow only upload.
– Security
– Asynchronous Architecture
• Avoid locking the base tables
– Data Sub-setting
• DMS supports highly granular (column-level and row-level) selection of base table data.
• Dynamic data range based on logical record set qualification
– Conflict/Error Detection and Resolution
• DMS provides built-in conflict resolution capabilities via the Server Wins/Client Wins rules.
• Conflict resolution can be customized by developer.
• Mobile Server administrator can further manage conflicts.
– Multi-Language/Multi-Platform Support
Key Features
27
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Sync Features
– Synchronization Styles • Automatic Synchronization allows DMS to invoke synchronization in the background that is
trigger/event based.
• Manual Synchronization allows user or application to control synchronization timing.
– Schema Evolution • Application schema evolution can be supported by publishing new versions of client-side database
and matching application binaries. A large European customer, using DMS for several years, frequently updates their schema without disruption of service.
Synchronize data simultaneously within minutes from 4000 sensor devices using a 4-core middle tier machine that is feeding a database on a 4-core machine.
28
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Device Management Manage and control clients
– Device Management Client is automatically installed with Mobile Client.
– Administrator can perform device management through Mobile Manager • Retrieve and view individual device properties
• Set device properties
• Send device commands (e.g. retrieve log, install application, etc)
• Creating new device commands (using an easy scripting language)
In a major city, manage/deploy application updates to 1000 devices used in administering parking tickets on a standard 4 core system
29
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Oracle Database Mobile Server Summary Data Synchronization for Developers and IT
30
Centralized Device, User & Application Management
Encryptable & Re-startable
Scale up & Scale-out
Simple:
Fast:
Flexible:
Secure & Reliable:
Configurable & Customizable
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Agenda
The IoT Scalability Challenge
Use Cases & Solution Architecture
Oracle NoSQL Database
Database Mobile Server
Demonstration
Summary & QA
31
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
NoSQL As a Mobile and IoT Data Repository Enabling mobile, embedded, and IoT devices to connect to a central NoSQL repository for cloud or on-premise data analytics
32
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Agenda
The IoT Scalability Challenge
Use Cases & Solution Architecture
Oracle NoSQL Database
Database Mobile Server
Demonstration
Summary & QA
33
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Oracle Database Mobile Server & NoSQL Database Summary
34
Scale up & Scale out
Reliable, Secure, Simple Management
Parallel Processing
Scalable:
Fast:
Developer Friendly:
IT Friendly :
Configurable, Customizable, Open
Lower Cost of Operations
Faster Time to Market
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
• http://oracle.com/technetwork/database/database-technologies/database-mobile-server/
• http://blogs.oracle.com/mobile_and_embedded/
• http://community.oracle.com/community/database/ oracle-database-options/database_mobile_server
Additional Resources
35
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
Q&A
37
Michael Brey Director Development, Oracle ISV Migration Center email: [email protected]
Copyright © 2015 Oracle and/or its affiliates. All rights reserved. |
• Oracle.com Partner Hub oracle.com/partners/goto/hub-ecemea
• Migration Center Team Blog blogs.oracle.com/imc
feeds.feedburner.com/oracleIMC
• Partner Webcast Recordings youtube.com/OracleIMCteam
• Partner Webcast Presentations slideshare.net/Oracle_IMC_team
Oracle Partner Hub ISV Migration Center • twitter.com/OracleIMC
• plus.google.com/+OracleIMC
• facebook.com/OracleIMC
• linkedin.com/groups/Oracle-Partner-Hub-Migration-Center-4535240