integrating, exposing and managing distributed data with restful apis and open source

@cvanball @ManfredBo

Integrating, exposing and managing

distributed data

with RESTful APIs and open source

Cojan van Ballegooijen Red Hat @cvanballManfred Bortenschlager 3scale @ManfredBo

At Endpoint2015, Sept. 4, Amsterdam


Outline

1. Power of data integration and Web APIs

2. Solution overview

3. Data integration and exposition via data virtualization

4. API management

5. Take aways

2


1. Data integration and Web APIs


DataEverywhere!

4

@cvanball @ManfredBo 5


Data is nothing without analytics

Analytics require data access.

Data access requires integration of multiple and diverse data sources.

6

⇒ APIs

⇒ Data Virtualization


2. Solution overview


Solution overview

8

External

API Consumers

Data

Abstr

action

La

ye

r

Data

VirtualizationAPI ManagementMultiple, Diverse

Data Sources


3. Data integration and exposition throughData Virtualization


Don’t move your data, virtualize it


What is data virtualization?


JBoss Data Virtualization (Teiid)

12


Tooling

13


Tooling

14


Demo content

15


4. API management


APIs make access to digital assets simple.

API management enables full control and visibility.

17


API management needs to provide technical- and business operations functionality

18


API Program Management

19

@cvanball @ManfredBo 20


Access Control

Authentication and authorization to identify the originator

of incoming traffic and ensure only permitted access.

Rate Limits and Usage Policies

Usage quotas and restrictions on incoming traffic to keep

loads predictable.

Analytics

Data capture and analysis of traffic patterns to learn how

the API is being used.

21


A good API management deployment model

22

API

Consumer

API

Provider

Traffic

Monitoring

API ManagementAccess Control

Usage Policies

Analytics

Developer Portal

Billing


Demo content

1. Integrate virtualised endpoint

2. Define mappings

3. Launch developer portal

4. Analyse API traffic

23


5. Take aways


Take awaysBig Data seems awesome. But data is useless without analytics.

To facilitate analytics, diverse data needs to be integrated and provided.

This seems hard, but does not have to be.

Data virtualisation and API management can make this very easy.

Both can be used independently – but naturally fit welltogether.

25


Teiid:

http://www.teiid.org

JBoss Data Virtualization:

http://www.jboss.org/products/datavirt/overview/

3scale Tutorials:

https://support.3scale.net/

API Economy ebooks:

http://www.3scale.net/resources/reports/

Further resources

26

http://www.teiid.org/

http://www.jboss.org/products/datavirt/overview/

https://support.3scale.net/

http://www.3scale.net/resources/reports/


Integrating, exposing and managing distributed data with RESTful APIs

and open source

Contacts:

Cojan van BallegooijenManfred Bortenschlager

At Endpoint2015, Sept. 4, Amsterdam


Demo Backup

integrating, exposing and managing distributed data with restful apis and open source

Technology