event stream processing - general electric · 2020-03-30 · event stream processing. about event...

10
Event Stream Processing © 2020 General Electric Company

Upload: others

Post on 12-Jun-2020

8 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Event Stream Processing - General Electric · 2020-03-30 · Event Stream Processing. About Event Stream Processing. Analyze continuously flowing data over long periods of time where

Event Stream Processing

© 2020 General Electric Company

Page 2: Event Stream Processing - General Electric · 2020-03-30 · Event Stream Processing. About Event Stream Processing. Analyze continuously flowing data over long periods of time where

Contents

Event Stream Processing 1

About Event Stream Processing 1

Getting Started with Event Stream Processing 2

Getting Started with Event Stream Processing 2

Creating your Event Stream Processing Service Instance 3

Using Event Stream Processing 6

Using Event Stream Processing 6

ii Event Stream Processing

Page 3: Event Stream Processing - General Electric · 2020-03-30 · Event Stream Processing. About Event Stream Processing. Analyze continuously flowing data over long periods of time where

Copyright GE Digital© 2020 General Electric Company.

GE, the GE Monogram, and Predix are either registered trademarks or trademarks of General Electric Company. All other trademarks are the property of their respective owners.

This document may contain Confidential/Proprietary information of General Electric Company and/or its suppliers or vendors. Distribution or reproduction is prohibited without permission.

THIS DOCUMENT AND ITS CONTENTS ARE PROVIDED "AS IS," WITH NO REPRESENTATION OR WARRANTIES OF ANY KIND, WHETHER EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO WARRANTIES OF DESIGN, MERCHANTABILITY, OR FITNESS FOR A PARTICULAR PURPOSE. ALL OTHER LIABILITY ARISING FROM RELIANCE UPON ANY INFORMATION CONTAINED HEREIN IS EXPRESSLY DISCLAIMED.

Access to and use of the software described in this document is conditioned on acceptance of the End User License Agreement and compliance with its terms.

© 2020 General Electric Company iii

Page 4: Event Stream Processing - General Electric · 2020-03-30 · Event Stream Processing. About Event Stream Processing. Analyze continuously flowing data over long periods of time where
Page 5: Event Stream Processing - General Electric · 2020-03-30 · Event Stream Processing. About Event Stream Processing. Analyze continuously flowing data over long periods of time where

Event Stream Processing

About Event Stream ProcessingAnalyze continuously flowing data over long periods of time where low-latency incremental results areimportant

SAS Event Stream Processing enables you to build applications that can quickly process and analyze largevolumes of streaming data so you can examine and understand events as the data is being generated. Youcan analyze continuously flowing data over long periods of time where low-latency incremental resultsare important.

Figure 1: Event Stream Processing Conceptual Overview

Event Stream Processing brings value in delivering real-time data for

• Manufacturing or Field Service to identify anomalies in system or device performance and avoidequipment failure

• Healthy professionals monitoring critical patient progress can receive patient vital statistics fromvarious sensors across different equipment and respond to urgent alerts or send recommendations topatients remotely in real time.

• Marketing for contextual analysis such as, streaming call data records to identify potential problems,patterns, or opportunities, and to enhance accuracy of predictions.

• Banking and capital market and trading professionals can receive real-time analysis of transactionswith very short latency to trigger real time alerts and actions for fraud detection and timely remedy.

To subscribe to this service during the Beta release, follow the instructions in Getting Started with EventStream Processing on page 2

© 2020 General Electric Company 1

Page 6: Event Stream Processing - General Electric · 2020-03-30 · Event Stream Processing. About Event Stream Processing. Analyze continuously flowing data over long periods of time where

Getting Started with Event Stream Processing

Getting Started with Event Stream ProcessingSet up your user authorization for the Event Stream Processing service.

Prerequisites for using Event Stream Processing during Beta Release

To ensure that you are successful using the service during the Beta release, SAS will work with you tolearn more about how you want to use the service and about the data you plan to stream. If you have notalready done so, please complete the survey (also linked from the service tile) to begin.

Note: Your subscription to the service will not work if you have not completed the survey and workedwith SAS to set up your environment.

Setting up Your Environment

Once you are approved to participate in the Beta test and to use the Event Stream Processing service, youmust first subscribe to the Predix User Account and Authentication (UAA) service as the trusted issuer.You can use the UAA dashboard or the Cloud Foundry command line interface to create and configureyour service.

Note:

If you have used other services from the Predix Catalog, you probably have UAA services set up and canuse the existing UAA credentials. You can create up to 10 service instances from the same UAA client. Ifthis is the case, you can start with Step 4 in the Setup Task Roadmap to create your Enterprise Connectservice instance.

Setup Task Roadmap for Event Stream Processing

# Task Description

1 (Optional) Configure your proxy settings if necessary. Depending on your location and network configuration, you may

need to configure your proxy settings to access remote resources.

See Defining Proxy Connections to Remote Resources.

3 Deploy your application to Cloud Foundry. If you do not have an application, you can create a test application.

[For an example of deploying a Predix Hello World Web application

to cloud foundry, see Creating and Deploying a Simple Web App to

Cloud Foundry.

2 Create the UAA service instance as the trusted issuer. Create an instance of User Account and Authentication (UAA)

service. UAA is the authorization server that each platform service

uses for authentication.

For more information, see Creating a UAA Service Instance.

3 Create OAuth2 clients to setup access to your service

authenticated using UAA.

When you create a UAA instance, an admin client is automatically

created for you to access UAA for additional configuration. You can

create a new client for your service instance with specific scopes.

If an Oauth2 client already exists, you can update the client to add

your service instance.

For more information, see Creating an OAuth2 Client.

2 © 2020 General Electric Company

Page 7: Event Stream Processing - General Electric · 2020-03-30 · Event Stream Processing. About Event Stream Processing. Analyze continuously flowing data over long periods of time where

# Task Description

4 Update the OAuth2 client to add service specific scopes

or authorities.

To enable your application to access a platform service, your JSON

Web Token (JWT) must contain the scopes required for a platform

service.

For more information see Updating the OAuth2 Client for Services.

5 Bind your application to the UAA service instance. To establish communication between your application and the

platform service, you must bind the application to the service.

See Binding an Application to the UAA Instance.

Creating your Event Stream Processing Service InstanceCreate a service instance and subscribe to Event Stream Processing using Coud Foundry commands.

Before you Begin ...

Before creating a service instance for Event Stream Processing you must have completed the SAS survey.Once you are approved to use the service, create the base URLs for UAA instances that the Event StreamProcessing service instance will trust. See Getting Started with Event Stream Processing on page 2.

Procedure

1. Sign into your Predix account at https://www.predix.io.2. Navigate to Catalog > Services tab, and click the Event Stream Processing service tile.3. Click Subscribe on the required plan.4. On the new Service Instance page, enter the following information:

Field Description

Org Select your org.

Space Select the space for your application.

User Account & Authentication

(UAA)

Choose an existing UAA instance or create a new instance of UAA. For more information,

see Creating a UAA Service Instance

Service instance name Specify a unique name for your instance.

Service Plan Select a plan.

Using Cloud Foundry Commands to Create your Event Stream Processing Service Instance

Procedure

1. List the services in the Cloud Foundry marketplace.

cf marketplace

The Event Stream Processing service, event-stream-processing-service, is listed as anavailable service.

2. Create an Event Stream Processing service instance.

cf create-service event_stream_processing <plan> <my_service-event_stream_processing_instance> -c

© 2020 General Electric Company 3

Page 8: Event Stream Processing - General Electric · 2020-03-30 · Event Stream Processing. About Event Stream Processing. Analyze continuously flowing data over long periods of time where

'{"trustedIssuerIds":["https://<predix-uaa-instance-uri>/oauth/token"]}'

where:

<plan> is the plan associated with a service.3. Bind your Event Stream Processing gateway service instance to your application to provision

connection details for your service instance in the VCAP environment variables. Cloud Foundryruntime uses VCAP_SERVICES environment variables to communicate with a deployed applicationabout its environment.

Use the Cloud Foundry CLI to log into Cloud Foundry:

cf login4. Bind your application to the service instance you created.

cf bind-service <application_name><my_event_stream_processing_instance>

5. Restage your application to ensure that environment variable changes take effect:

cf restage <application_name>6. View the environment variables for your application:

cf env <application_name>

The environment variables which contain your basic authorization credentials are shown:client ID andthe endpoint URI:

"VCAP_SERVICES": {"event-stream-processing": [{"credentials": {"admin-token": "

YWRtaW46ZUVEMTkxdFBPOTgzMjZjMYMtNXIwOS00OGIzLTg2YzMtNDL1YTk5M2U0BzJj""ec-info": {"ids": {"<random_string>”,"<random_string>"

], "trustedIssuerIds": ["https://UAA-Instance-URL.predix-uaa.run.aws-usw02-

pr.ice.predix.io/oauth/token"]},"service-uri": "https://<Predix-Zone-Id>.run.asv-

pr.ice.predix.io""usage-doc": "https://github.com/event-stream-processing/ec-sdk/

wiki","zone": {"http-header-name": "Predix-Zone-Id","http-header-value": "<Predix-Zone-Id>","oauth-scope": "event-stream-processing.zones.<Predix-Zone-

Id>.user"}},"label": "event-stream-processing","name": "hello-world-app-1",

4 © 2020 General Electric Company

Page 9: Event Stream Processing - General Electric · 2020-03-30 · Event Stream Processing. About Event Stream Processing. Analyze continuously flowing data over long periods of time where

"plan": "<plan>","provider": null,"syslog_drain_url": null,"tags": [],"volume_mounts": []

} ]}

7. Add the oath-scope to your client or user in the UAA Authority.8. Add the Event Stream Processing scope to the UAA instance.

© 2020 General Electric Company 5

Page 10: Event Stream Processing - General Electric · 2020-03-30 · Event Stream Processing. About Event Stream Processing. Analyze continuously flowing data over long periods of time where

Using Event Stream Processing

Using Event Stream Processing

Before You Begin

Complete the survey provided on the service tile. SAS will work with you to evaluate your business caseand provide further instructions.

For assistance, please refer to the Event Stream Processing User Guide: https://www.sas.com/en_us/learn/software/event-stream-processing.html

6 © 2020 General Electric Company