administrative reporting of sas visual analytics 7.1 and integration with environment manager 2.4...

20
Start Administrative Reporting of SAS Visual Analytics 7.1 and Integration with Environment Manager 2.4 Service Architecture Framework 22nd April 2015 Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy Francesco Marelli - CTO

Upload: francesco-marelli

Post on 18-Jul-2015

369 views

Category:

Software


1 download

TRANSCRIPT

Page 1: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

Start

Administrative Reporting of SAS Visual Analytics 7.1 and Integration with

Environment Manager 2.4 Service Architecture Framework

22nd April 2015

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland

Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Francesco Marelli - CTO

Page 2: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

Agenda Keinavo

Keinavo Cloud Services

Instance of a distributed SAS HP Analytics Infrastructure in the Keinavo Cloud

SAS Visual Analytics 7.1 built-in administration reporting

SAS Environment Manager 2.4

SAS EM 2.4 Service Management Architecture Enablement

SAS EM 2.4 SMA Integration with SAS Visual Analytics

Implementation in Keinavo Cloud Services

Agenda

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 3: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

Keinavo Independent expert consultants since 2006

End to end project lifecycle

Strategy, Auditing and Process Analysis

Hosting and management of Big Data analytics platforms - Cloud Services

Software development

Offices in Switzerland and Italy

International clients in the EMEA region

SAS Alliance Partner - SAS Global Practice

Keinavo

Analytics One-Stop Shop

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 4: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

Keinavo Cloud ServicesYour SAS Solutions and Analytics Platform in the cloud

Bespoke architecture design and implementation

From simple to very complex multi-machine systems

Various level of service available

Typical time to market: 5 working days

Efficient web based support ticket system

Always up to date

Complete peace of mind

Keinavo Cloud Services

Keinavo Cloud Services: Performance and freedom of choice

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 5: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

Instance of a Distributed SAS HPA Architecture

Instance of a Distributed SAS HPA Architecture

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 6: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

SAS VA 7.1 Built In Administration Reporting 1

SAS VA 7.1 Built In Administration Reporting

SAS VA 7.1 provides a predefined audit report for administrators

The collection and loading of the data for the report must be manually enabled

Set property va.AuditingEnabled = true for Visual Analytics ConfigurationSchedule autoload for scheduling user.

Data is refreshed in memory every 15 minutes by default

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 7: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

SAS VA 7.1 Built In Administration Reporting 2

SAS VA 7.1 Built In Administration Reporting

Top Usage (Users, Tables, Reports, Mobile Report Subscriptions)

Visual Analytics (Usage by Time, Users Activity, Component Usage)

LASR Server (LASR Server Usage, Data Usage by Component, Data accessed)

Components (Component Usage, Users and Actions)

Data Sources (Data Sources usage by user and time)

Top Data Sources (By user and component)

Administrative Detail (Tables loaded log, User activity log, Failure log)

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 8: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

SAS Environment Manager 2.4SAS Environment Manager 2.4

SAS Environment Manager was introduced with SAS 9.4

Based on VMwares’s vFabric Hyperic monitoring framework complemented with technology provided by SAS

It is a complete, SAS-aware, out-of-the-box monitoring solution

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 9: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

SAS Environment Manager 2.4 – Logical Architecture

SAS Environment Manager 2.4

SAS Environment Manager

Monitoring and Management of SAS ResourcesCollection and Reporting of metrics for SAS ResourcesMonitoring of EventsCustomisable AlertsEscalation processes for alertsSAS EM Data Mart for low level analysis and forensics analysis (BI on BI)

SAS Environment Manager is installed and configured during installation

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 10: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

SAS Environment Manager 2.4 - ResourcesSAS Environment Manager 2.4

SAS EM works on 3 resource levels

Platforms (Physical or Virtual machines)Servers (SAS Servers, DB Servers, Web Application Servers)

Services (Web Application in Web Application Servers, etc.)

Users can navigate the resources to get information such as

? How many users are currently connected? What is the CPU usage trend for a platform? What is the percentage of usage of the SAS Work area? What is the I/O rate for a given file system? What is the trend of memory usage? Other...

There is a wealth of predefined events and alerts, it is also possible to define customized events and alerts to suit customer’s specific needs.

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 11: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

SAS Environment Manager 2.4 - DashboardSAS Environment Manager 2.4

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 12: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

SAS Environment Manager 2.4 - MetadataSAS Environment Manager 2.4

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

SAS EM also provides an interface for managing SAS Metadata

Users, groups and rolesGroups and roles membershipsLogins and internal accounts

The interface is not meant to replace SAS Management Console for these tasks, but it can be an alternative and provides enhanced user administration features

Permission InspectorExplore Inheritance Diagram

Page 13: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

SAS EM 2.4 Service Management Architecture “SAS Environment Manager Service Management Architecture provides functions and capabilities

that enable SAS Environment Manager to fit into a service-oriented architecture (SOA)”

The following components form the SM Architecture and can be enabled

SAS EM Data Mart - Stores monitored data

Audit, Performance and Measurement (APM) ETL - Collects information from SAS logs and stores it in the SAS EM Data Mart

Agent-Collected Metrics (ACM) ETL - Collects information from the EM Database and stores it in the SAS EM Data Mart

Report Center - Extensive collection of SAS Stored Processes that report against the SAS EM Data Mart

Solution Kit Framework - Allows SAS Solutions to extend the capabilities of SAS EM by providing solution specific monitoring and metrics

SAS VA Data Feed - Allows for automatic copy of some EM DM tables to the VA Admin drop zone for auto-load in memory

SAS EM 2.4 Service Management Architecture

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 14: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

SAS EM 2.4 SM Architecture EnablementSAS EM Extended Monitoring enablement is a manual process, it provides

Automated SAS EM Resource configuration

Optimized Alerts for operational issues in a SAS Environment

Defined resource groups

Event exporting and importing

Monitoring of availability and responsiveness of SAS Web Applications

SAS EM Data Mart initialization

Report Center processes and reports

APM, ACM and Solution Kits ETL and VA Data Feed are optionally enabled in separate steps but required Extended Monitoring

SAS EM 2.4 SM Architecture Enablement

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 15: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

SAS EM 2.4 SM Architecture Enablement –Data Mart Tables

SAS EM 2.4 SM Architecture Enablement

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

ACM TABLES Description

AVAILABILITY Resource availability

FILEMOUNTS Usage data for file mounts on discovered platforms

GROUPINVENTORY * Resource groups defined in SAS Environment Manager

EVENTS Events logged by SAS EM

HOSTPLATFORMS * Metrics for platforms

HTTPCHECKS * Metrics for HTTP checks of web services

IOMSERVERS * Metrics for IOM Servers

MEASUREINVENTORY Inventory of measurements being performed

METADATASVRS * Metrics for Metadata Servers

NETWORKINTERFACE * Metrics for network performance

RESOURCEINVENTORY * Inventory of resources in SAS EM

TCSSERVERMGRS * Metrics for tcServers

WEBAPPSERVER * Metrics for SAS Web Applications

WIPDATADB * Metrics for SAS Web Infrastructure Platform

APM TABLES Description

RELATIONSHIPS Relationships between artifacts defined in other tables

ARTIFACTS Information about the artifcats in the environment

ARTIFACTSPHYSICALLOCATION Physical location of the artifacts

ARTIFCATUSAGEDETAILS * Usage information about the artifacts

ARTIFACTSUSERSESSIONS * Usage information about the artifacts in a session

AUDIT_ACCESSC * Audit records for object access events

AUDIT_ADMUSER * Audit information for administrative users activity

AUDIT_GROUP * Audit information for Identity Groups

AUDIT_TRANSACTIONS * Audit information for transactions

AUDITACCESSCONTROLDETAIL * Audit information about access requests

AUDITIM Audit information by time

DTINFOALL Information about log file access

LIBRARIES Information about SAS libraries in the environment

SERVERTYPEBYUSER Information about server access by user

SERVERUSAGEBYUSER Information about server usage by user

KITS TABLES Description

EMI-INFO Metrics for SAS EM ETL processes* Table copied to drop zone if SAS VA feed is enabled

Page 16: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

SAS EM 2.4 SM Architecture Enablement –Report Center

SAS EM 2.4 SM Architecture Enablement

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Report Center provides many “ready to go” reports organized by:

o Dymanics Reportso Datamarto Metadata Inventoro KITSo LASRo SASJobso Nightly Reportso ACM Reportso APM Reportso Audit Reports (Log Forensic)o EMI SAS Job ETL Reportso Event and Availability Reportso Sample Galleryo Ad Hoc Reporting

Page 17: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

SAS EM 2.4 SMA Integration with SAS VA

SAS EM 2.4 SMA Integration with SAS VA

After a successful run of the APM, ACM and Kits ETL processes, selected Environment Manager Data Mart tables are copied to the VA Admin drop zone for auto-load in memory (EVDMLA)

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 18: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

Implementation in Keinavo Cloud Services

Implementation in Keinavo Cloud Services

Keinavo Cloud Services include setup and ongoing management activities related to the SAS EM Architecture in every environment, SMP or MMP without limits to the number of servers used.

Inclusion of “SAS EM Data Mart enhanced by Keinavo”. Provides ETL jobs to create and populate an enhanced Data Mart with additional information to be used by non administrators and external reporting tools. Can be customized as per client’s needs.

We also provide additional preconfigured Visual Analytics Data Explorations and Reports that maximise the already rich information available in the SAS EM Data Mart

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 19: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

Implementation in Keinavo Cloud Services – ACM Data ExplImplementation in Keinavo Cloud Services

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy

Page 20: Administrative Reporting of SAS Visual Analytics 7.1  and Integration with  Environment Manager 2.4 Service Architecture Framework

Thank YouKeinavo Cloud Services

Thank You

keinavo.com/cloud-services

Keinavo SAGL - Corso Elvezia, 25 - 6900 Lugano – Switzerland /// Keinavo srl - Strada 6 A13, 20090 Assago Milanofiori (MI) - Italy