sas stored processes and developing web applications€¦ · · 2016-03-11sas stored processes...

SAS Stored Processes and Developing Web ApplicationsPhil MasonIndependent SAS Consultant

Contents

Creating a Simple Web App using Enterprise GuideMake a report

Turn it into a Stored Process

Use Stored Process Web App

Make a better Web AppAdd some HTML

Add Java Script

Make the best Web AppUse a Java Script framework

Make Report

Make a report

Use Enterprise Guide

Build a query

Query Builder

Query builder

Now you have a query

Make Stored Process

Make a Stored Process

Name it

View code

Pick Repository

Librefs

Prompts

Data Sources & Targets

Review

Edit Stored Process

Stored Process

Composed of:A metadata component

A code component

Alternative way to create a Stored ProcessCreate the code with an editor

In Management Console create the metadata/code

Let’s take a quick look at Management Console

Create using Management Console

Name it

Execution settings

Select server to run it on

Specify we want to stream output and that we can produce a package

Keep code in metadata

Edit Source Code

Define parameters

Run it via Enterprise Guide

Edit a Stored Process with Management Console

Find the one you want and double click it

Management Console

Name & Location

Management Console

Stored Process Web Application

Part of Integration Technologies

Allows running a stored processFrom a web browser

From an application such as EXCEL, MS Word

Parameters passed on URL appear as macro variables to Stored Process

Stored process web application

Get a menu down left

Run stored process from web app

Run stored process from browser

Run stored process from excel

Open one to run it

Results of run appear in EXCEL

Add a Graph to Stored Process

Result in web browser

Add parameter

Add prompt for macro parameter added

Stored Process using parameter via prompt

URL showing parameter passed

http://my.server/SASStoredProcess/do?_program=%2FShared+Data%2FSASTesting%2FTest3&product_line=Children

Enhance with HTML &

JavaScript

Make a better Web App

Use some HTMLGives us some more control

Use some JavaScriptGreat for adding more interactivity

Allows programming to control User Interface

Simple HTML

<h1>Pick a report to run</h1>

<a href="http://my.server/SASStoredProcess/do?

_program=%2FShared+Data%2FSASTesting%2FTest3

&product_line=Children"> Children</a><p>

&product_line=Clothes+%26+Shoes">Clothes & Shoes</a><p>

&product_line=Outdoors">Outdoors</a><p>

href="http://my.server/SASStoredProcess/do?_program=%2FShared+Data%2FSASTesti

ng%2FTest3

&product_line=Sports">Sports</a><p>

</body> </html>

HTML Menu

Report shown in browser

Using a form to run a Stored Process

HTML form is great for making User Interfaces

Form tagMake the first part of URL

Input tag, using different type settingsText – fields for text

Password – passwords where text is hidden

Radio – radio buttons

Checkbox – check boxes

Submit – submit buttons to execute URL using parts of form

HTML using Form

What’s displayed

Writing directly from Stored Process to browser

_weboutReserved fileref for writing from Stored Process to browser

%stpbegin macro sends output from procs to _webout

%stpend stops output going to _webout

Can write from a datastep to _webout

Best to turn automatic Stored Process macros off

New stored process to write HTML

Stored process produces this

Add iFrame to keep output on same page

Now menu & output on same page

Useful optional parameters for Stored Processes

_odsdest – lets us choose an ODS destination for type of output producedSwitch between HTML, RTF, PDF, EXCEL, etc.

_odsstyle – choose an ODS style

_debug – can produce the SAS log, execution times, etc._debug=log,time

_debug=2179 … this is my favourite

Define a dropdown menu for type of output

Output type is added to menu

HTML Headers

Set headers in HTML from stored process

Indicates what browser should do

rc = stpsrv_header("Content-type", "application/msword") ;

rc = stpsrv_header('Content-disposition','attachment; filename=test.rtf');

rc = stpsrv_header("Content-type", "application/pdf") ;

rc = stpsrv_header('Content-disposition','attachment; filename=test.pdf');

RTF output

Define dropdown for ODS style

Here is what 2 ODS style selections produce

Add some checkboxes

After report we get the log

After log we get time

Parts of URL for stored process call

http://khv-sas-iis.cfsi.local/SASStoredProcess/do?_program=%2FShared+Data%2FSASTesting%2FTest3&product_line=Children

&_debug=log&_debug=time

Useful automatic macro variables

Use automatic macro variables

Construct a URL using:&_srvname

&_srvport

What’s good about this technique

Easily make SAS code run from a web browser

Generate HTML, Excel, PDF or RTF easily.

Easily add parameters making it much more flexible

Build up a multiple page Web Application

What’s not so good

Tables and graphs don’t look as good as they couldCan improve their look with some more work within SAS

Tables lack some functionalityCant sort columns

Slow using lots of data

Table headers are not fixed, so they will scroll away if tables are long

Only some basic widgets available for building a UI

Only basic use of mouse for selecting

Adding some JavaScript for interactivity

onLoad – execute when page finishes loading

onUnload – execute when page closes

onKeyPress – execute when a key is pressed

onKeyUp – execute when a key is released

onMouseOver – execute when mouse is over something

onMouseOut - … when mouse moves away

onMouseDown … when left button is pressed

onMouseUp … when left button is released

onClick … when left button is clicked

onDblClick … when left button is double clicked

JavaScript Demo

Lets see some of those things…

Note: not all browsers support all JavaScript (in the same way)Try things out in all the browsers you might use

<html>

<head>

var popwin = null;

function open_popup() {

if (popwin == null)

popwin = window.open(

'http://www.google.com',

'top=150, left=350, width=250,

height=50, status=0, toolbar=0,

location=0, menubar=0, directories=0,

resizable=0, scrollbars=0'

function close_popup() {

if (popwin != null) {

popwin.close();

popwin = null;

function checkKey() {

var key = String.fromCharCode(

window.event.keyCode);

if (key == 'X') {

alert(

"You pressed the X key"

</script>

Some added JavaScript for extra functionality

JavaScript providing more interactivity</head>

<body onload='alert("finished loading");' onunload='alert("finished unloading");'

onkeypress='window.status="key pressed is: " +

String.fromCharCode(window.event.keyCode) ;'

onkeyup='window.status="key up"; checkKey() ;'>

Pop-up a window with information by moving over <a href='#'

onmouseover='open_popup(); window.status="Hovering over the link" ; return true ;'

onmouseout='close_popup(); window.status=" " ; return true ;'>here</a>.

<p>Pop-up a window with information by holding mouse button down <a href='#'

onmousedown='open_popup();' onmouseup='close_popup();'>here</a>.

<p><a href='#' ondblclick='open_popup();'>Double click to open</a>,

<a href='#' onclick='close_popup();'>single click to close here</a>.

<p><a href='#' style='font-size="x-large"' onmousemove='open_popup();'>Move

mouse over this to open</a>,

<a style='font-size="x-large"' href='#' onmousemove='close_popup();'>move

over this to close</a>.

<p>Press <b>X</b> to make an alert window pop up.

<p>Hold down a key to see what it is in the status bar.

</body>

</Html>

Stored Process generates HTML

Some excerpts…

<option value="/Shared Data/SASTesting/cabotCollectionsDashboard">Month to Date</option>

<option value="/Shared Data/SASTesting/ccDashDaily">Daily</option>

</select>

<input type="checkbox" name="_debug" value="time">Show time taken<nbsp>

<input type="checkbox" name="inline" value="1">Inline?<nbsp>

More excerpts of HTML

organisationName <select name="organisationName" onchange="this.form.submit();">

<option value="Cabot Debt Purchase " selected>Cabot Debt Purchase </option>

<option value="Cabot Stratford Serviced ">Cabot Stratford Serviced </option>

</select>

</form>

</iframe>

</body>

</html>

Use JavaScript Libraries

A few good JavaScript libraries

jQueryWrite less, do more

HandsOnTable or EasyUI Excel-like spreadsheet for Apps

HighChartsCreate interactive web charts easily

D3Data Driven Documents

Manipulating your web page

jQuery makes it easy to select parts of your page and attach functionality

$(document).ready(function(){

$("button").click(function(){

$("p").hide();

$("#div1").fadeIn();

$("#div2").fadeIn("slow");

$("#div3").fadeIn(3000);

$("#div1").load("demo_test.txt");

</script>

<h2>Let jQuery AJAX Change This Text</h2>

</div>

<button>Get External Content</button>

Making a better table in web browsers

Making interactive charts

Creating Data Driven Documents

Hosted Libraries

You can download JavaScript libraries and keep on your site

Or you can use a Hosted Library, such as Google’s

read about it here https://developers.google.com/speed/libraries/

<script

src=“https://ajax.googleapis.com/ajax/libs/jquery/2.1.4/

jquery.min.js”></script>

Some host their own library

</script>

</script>

How to use SAS with JavaScript objects

HTML 5 structures your page

CSS 3 controls the look and feel

JavaScript handles the interactivity

Data typically either hard-coded or provided in JSON, CSV, TSV, …

SAS Stored ProcessesProvide the data in CSV or JSON format

using data steps or PROC JSON

Create and customise the HTML, CSS & JavaScript

Using data steps or PROC STREAM

Use JSON with Stored Processes

What is JSON and why use it?

Key-Value pairs

Man and Machine readable

Nested if necessary

Used by many JavaScript objects

Is a subset of JavaScript Object Notation, which is how objects in JavaScript are built

Sometimes XML or CSV can be used

Very flexible

can represent complex nested hierarchies of data

Example{

"name": "Phil Mason",

"home": {

"town": "Wallingford",

"phone": 1491824891,

"current home": true,

"ages": [

Data Step to produce JSON

Can run from a stored process

Write to _webout to stream to browser

Can define macros, to make it flexible and easy to repeat

Can handle very complex & nested JSON

Example data step making JSONdata _null_ ;

set sashelp.class end=_end ;

if _n_=1 then put '[' ;

put '{' ;

put '"Name":"' name +(-1) '",' ;

put '"Sex":"' sex +(-1) '",' ;

put '"Age":"' age +(-1) '",' ;

put '"Height":"' height +(-1) '",' ;

put '"Weight":"' weight +(-1) '"' ;

put '}' ;

if not _end then put ',' ;

else put ']' ;

"Name":"Alfred",

"Sex":"M",

"Age":"14",

"Height":"69",

"Weight":"112.5"

"Name":"Alice",

"Sex":"F",

"Age":"13",

"Height":"56.5",

PROC JSON

SAS 9.4

Easily produces JSON from SAS datasets

Can produce more complex JSON as well as simple JSON

Can use macros to write PROC JSON, making it very flexible

PROC JSON

Minimum code needed

Produces default output

"SASJSONExport": "1.0",

"SASTableData+CLASS": [

"Name": "Alfred",

"Sex": "M",

"Age": 14,

"Height": 69,

"Weight": 112.5

"Name": "Alice",

"Sex": " F",

"Age": 13,

"Height": 56.5,

"Weight": 84

proc json out=temp ;

export sashelp.class ;

Better PROC JSON code

Pretty - lays out the JSON clearly

noSAStags - leaves out SAS metadata from the JSON

proc json out='/tmp/class.json' pretty nosastags ;

export sashelp.class ;

"Name": "Alfred",

"Sex": "M",

"Age": 14,

"Height": 69,

"Weight": 112.5

Produces this output

JavaScript libraries with

PROC STREAM

Processes text and expands macros within it

Text is sent to an external file

Can execute SAS code while processing the input stream

using %sysfunc(dosub(fileref))

Can include text into stream for processing

using %include filleref

Files can be read into stream, but macros not processed

using &streamdelim readfile filref

Newlines can be forced in output

using &streamdelim newline

Simple example%macro cols(n) ;

%do i=1 %to &n ;

%end ;

%mend cols ;

filename out '/folders/myfolders/test.html' ;

proc stream outfile=out ;

<table>

</table>

General Approach

Find an example

Pick a visualisation

Close to something you want

Could be changed to meet needs

Could be combined with other things to meet needs

Check it for suitability

Some things are easier than others

Is it free?

Handle libraries

Make sure you are pointing to a local copy or CDN

Copy & Test locally

Number Display Example

http://dc-js.github.io/dc.js/examples/cust.html

Wrap in a Stored Process

Write code to _WEBOUT using

Data step

Proc Stream

Mixture of both

Leave out the %stpbegin & %stpend macros

Call using Stored Process Web Application from browser

http://server57562.uk2net.com/SASStoredProcess/do?_program=%2FUser+Folders%2FPhil+Mason%2FMy+Folder%2Fd3+

Use Proc Stream with PRESCOL

What should we change?

Parameters

So we can control what it does

So it works using our data

Libraries

Often they point to resources on another web site

Can copy to our web site

Can use Content Delivery Network (CDN)

Parameters

Identify anything we want to alter

If it is a one time change, then make the change

If we want to change it from run to run, then it is a candidate for macros

Identify anything we want to add, e.g. a title

Identify where the data is coming from

What format is it in?

We will need to make our data in same format

Consider options for reproducing data

How to change things?

Macro variables

Replace shorter things we want to control

Macro programs

Replace longer things we want to control

Make use of looping, conditions, dataset I/O, file I/O, etc.

Change width and height to a macro variable

Add corresponding parameters to Stored Process

Use parms in call to Stored Process

http://server57562.uk2net.com/SASStoredProcess/do?_program=%2FUser+Folders%2FPhil+Mason%2FMy+Folder%2Fd3+

Can just make a flat file

Can make a stored process to deliver data

Data Step

Proc Stream

Make data into a CSV “file”

Make a Stored Process to deliver data

Modify Stored Process to use data from Stored Process Use the d3.csv function to read in CSV data into a

JavaScript array.

Remove the hard-coded data

Add a call to load data

All code needs to be inside function

Finish off function call at the end with })

Stored Process using macro parms and another Stored Process for data

Where have we go to?

Stored Process for Program

Creates HTML, JavaScript, CSS

Stored Process for Data

Produces a stream of CSV data

Possibly copies of libraries on our Infrastructure

JavaScript

We have a working little JavaScript/SAS Stored Process Visualisation Web Application!

Next Steps

Add more graphs to these 3 based on the same data

Parameterise the data used

Change variables too

Make them all Stored Process parameters

Therefore they are also macro variables

Change Stored Process making data to be general purpose by feeding a dataset name to it.

Create several Stored Processes like this and combine them to make a dashboard.

Repeat object(s) to make a Dashboard

We don't have time for this, but basic steps are …

Create a bunch of empty div sections in HTML 5

perhaps just with a H1 so you can see them

Make some CSS to lay them out how you like

easy to do accordions, tabs, sliding layouts, etc.

Use some jQuery to fill the div sections

use Ajax calls to do it

Possibly add some drop down selections lists, etc.

Use jQuery to add info from there to your Ajax calls

That’s about it!

Conclusion

Conclusions

It’s easy to find great JavaScript visualisation software

It’s easy to wrap it up and customise it with a Stored Process

It’s easy to feed it with data from another Stored Process

Combine some of these into a dashboard or application

Put it all together and you have yourself a powerful cutting edge visualisation system.

Extras

Some great links to useful resources

http://www.robslink.com/SAS/Home.htm

http://www.visualisingdata.com/index.php/resources/

http://www.jsgraphs.com/

http://www.graphviz.org/Gallery.php

http://www.highcharts.com/demo

http://www.amcharts.com/demos/

https://github.com/mbostock/d3/wiki/Gallery

http://dc-js.github.io/dc.js/

Some great diagrams

sas stored processes and developing web applications€¦ · · 2016-03-11sas stored processes...

Documents

sas 9.3 stored processes: developer's guide

stored processes: how to build, how to run, and why they...

sas 9.4 stored processes: developer's guide, third...

sas financial management 5 · sas 9.1.3 installations of...

257-31: sas® enterprise guide® stored processes, part 1...

moving data from excel to sas - michigan · pdf filemoving...

257-2011: using sas® stored processes with javascript and...

sas 9.3 stored processes: developer's...

creating stored processes with dynamic, cascading...

stored processes or how to make you use sas® without even...

135-30: creating and using sas® stored processes with sas

copyright © 2005, sas institute inc. all rights reserved....

using sas® stored processes inside...

using sas® stored processes to build a calibration...

sas 9.2 stored processes: developer’s...

375-2011: in control of your data warehouse processes with...

paper 1488-2014 custom bi tools using sas stored...

stored process kjort fra va - analytics, business … stp og...

cloud, on-premises, and devops: implementing sas® customer...

sas stored process web services and dynamic data...