it business intelligence technical overview

25
IT BUSINESS INTELLIGENCE Technical Overview Specialists in IT Business Intelligence

Upload: smt-data-as

Post on 10-Mar-2016

216 views

Category:

Documents


1 download

DESCRIPTION

The paper which describes ITBI from SMT Data

TRANSCRIPT

Page 1: IT Business Intelligence Technical Overview

IT BUSINESS INTELLIGENCE Technical Overview

Specialists in IT Business Intelligence

Page 2: IT Business Intelligence Technical Overview

TECHNICAL OVERVIEW: IT Business Intelligence2

Page 05

Page 09

Page 13

Page 21

TRANSPARENCY BETWEENIT AND BUSINESS

TRANSPARENCY,OVERVIEW AND INSIGHT

IT BUSINESS INTELLIGENCE – STEP BY STEP

IT BUSINESS INTELLIGENCE– THE TOOLBOX

CONTENTS

Page 3: IT Business Intelligence Technical Overview

Most companies struggle

to translate IT spending

into business value

3 TECHNICAL OVERVIEW: IT Business Intelligence

Page 4: IT Business Intelligence Technical Overview

4 IT Business Intelligence: WHITEPAPER

A RELATION OFTEN

OVERLOOKED

Page 5: IT Business Intelligence Technical Overview

TECHNICAL OVERVIEW: IT Business Intelligence5

IT BUSINESS INTELLIGENCE - ITBI™ Most companies struggle to translate IT spending into higher revenues

or alternatively reduce IT spending by changing business processes or

user demand and behaviour. This struggle is often caused by a lack of

understanding of how IT supports the business and how business im-

pacts the IT infrastructure.

Two things are required to gain such an understanding. The first is to

create transparency in the relation between IT and the business. By

showing directly the business value and the cost of IT you can openly

share how IT resources is actually utilized. This again will show how

business activities are reflected in IT activities and vice versa. The second

requirement is to implement a common language between IT and the

business, most likely in financial units of Euros or Dollars, and to avoid

technical terms like GB, MHz etc.

ITBI™ from SMT Data merges information from IT and the business

and creates transparency of the relation between the two, to ultimate-

ly support the business objectives of the organization.

IT systems generate a wealth of technical data describing anything

from hardware utilization to user activity or service levels. A main-

frame has more than 100,000 points of measurement and a Windows

server more than 2,500, all recorded continuously.

Even medium IT installations register many million rows and columns

of measurements every single day. Operational real time monitors

use this data to evaluate the actual state, often against standard

thresholds. The very same data, however, can be used for creating

valuable information at all organizational levels.

TRANSPARENCY BETWEENIT AND BUSINESS

HIGHLIGHTS

Any business constantly produces and stores a

wealth of data.

Data is only valuable when turned into useful

information.

Conventional business intelligence tend to

neglect even the most basic data from the IT

system itself.

DATA

INFORMATION

A NEW LOOK

Page 6: IT Business Intelligence Technical Overview

IT Business Intelligence: WHITEPAPER 6

To transform such technical details into useful information requires

massive data reduction as well as data refinement and the coupling of

data from other sources, often organizational or application related,

to create new information. ITBI™ delivers standard data collection

interfaces to all conventional IT platforms in order to provide quick

implementation and a rapid return on investment.

ITBI™ from SMT Data includes more than 200,000 active sets of rules

and policies for reducing and refining the collected standard IT meas-

urements. The rules- and policy-engine is called the SMT/Dictionary

and this is the essence of SMT Data’s vast experience from many years

dedicated to this line of work.

The extracted information is stored in the flexible SMT/Transparency

Grid, which is prepared for easy addition of company specific data like

business activity, organizational data and budgets. This combination

of technical and business-related data sources makes ITBI™ informa-

tion extremely valuable across the entire organization.

Finally, SMT Data provides a state-of-the-art user interface for reporting

and drill-down analysis, including dashboards on PC, tablets or smart-

phones and Web Portals for dynamic reports published on intranet or

extranet. Advanced users are able to easily design and create their own

reports.

Page 7: IT Business Intelligence Technical Overview

From unsorted data

into structured

and comprehensible

decision support

7 TECHNICAL OVERVIEW: IT Business Intelligence

Page 8: IT Business Intelligence Technical Overview

8 IT Business Intelligence: WHITEPAPER

SUPPORT FOR ALL

Page 9: IT Business Intelligence Technical Overview

TECHNICAL OVERVIEW: IT Business Intelligence9

ITBI™ provides IT top management with information for decision-

making and for understanding and conveying the relation between IT

and the business.

ITBI™ also delivers business management information concerning IT

service and costs by application, business area, system and department

making it easy to optimize business demand and user behaviour.

ITBI™ also supports IT procurement in its efforts to plan for investments

and budgets as well as to distribute IT costs across business areas

according to IT usage.

Within IT operations using ITBI™ guides senior technicians and mid-

dle management in the area of ITILs IT Service Delivery with regards

to Capacity Management, Service Level Management, Performance

Management, Demand Management and IT Financial Management.

Finally, within the development community ITBI™ allows application

responsible managers to easily spot growth or service threshold viola-

tions within their individual area of interest.

ITBI™ Summary

ITBI™ creates transparency between IT and the business by automati-

cally gathering raw technical data, combining it with organizational

and financial data and presenting the resulting information at differ-

ent organizational levels and to different stakeholders. The common

and consolidated ITBI™ data warehouse delivers valuable information

at the strategic CxO level, tactical management level and at the opera-

tional or technical level. All are using the same and single data source

for information, so we call it “One Truth”.

HIGHLIGHTS

IT BI supports the IT man-agement with informa-

tion for decision making and conveying the value

of IT.

ITBI supports the top management with insight into the relation and value

creation between IT and business.

ITBI supports procure-ment in its effort to plan

capacity and distribute costs.

SUPPORT FOR IT

SUPPORT FOR TOP MANAGEMENT

SUPPORT FOR PROCUREMENT

TRANSPARENCY,OVERVIEW AND INSIGHT

Page 10: IT Business Intelligence Technical Overview

IT Business Intelligence: WHITEPAPER 10

ITBI™ focuses on analysis, planning and decision support, transforming

extreme amounts of detailed technical data - plus individual business

data - into structured and comprehensible executive information.

The customer should expect:

• Quickinstallationduetopre-definedinterfacesandSMT/Dictionarysettings

• High-speeddatacollectionduetothepre-defineddatafiltrationandreduction

• FastbenefitandROIduetopre-defineddatarecognitionandstandardreporting

• Low-effortexpansionpossibilitiesduetothecentralrules-andpolicyengine

Page 11: IT Business Intelligence Technical Overview

A new, common

language, based on a

sublime dictionary

11 TECHNICAL OVERVIEW: IT Business Intelligence

Page 12: IT Business Intelligence Technical Overview

IT Business Intelligence: WHITEPAPER 12

THE PROCESS

Page 13: IT Business Intelligence Technical Overview

TECHNICAL OVERVIEW: IT Business Intelligence13

THE SMT/DICTIONARY ITBI™ data flow and handling is controlled from a

central control program, the SMT/Dictionary which

is recognized for its supreme ability to simplify the

management of individual policies to reduce vast

amounts of technical data and to add individual cus-

tomer specific data sources.

ITBI™ INPUT:

Standard IT plus customer specific data sources .

As a standard, SMT Data’s tools for ITBI™ collect data from the most

common IT platforms: Windows (including VMware), UNIX (including

Linux and Solaris), and IBM z/OS mainframes.

Communication to, from and between SMT tools is extremely flexible.

Data can be pulled or pushed at specific times or intervals. Several data

formats can be used, ranging from comma-separated flat files to XML.

This flexibility makes it very easy for SMT tools to interface with new

local data sources.

DATA REDUCTION:

• Data selection

Only data feeds with ITBI™ potential are selected

• Datafiltration

Details without ITBI™ potential are discarded

• Datarefinement

Data is provided with attributes describing its relation to the business

IT BUSINESS INTELLIGENCE – STEP BY STEP

local data sources.

Only data feeds with ITBI™ potential are selected

Details without ITBI™ potential are discarded

Page 14: IT Business Intelligence Technical Overview

IT Business Intelligence: WHITEPAPER 14

• Dataaggregation

Data is summarized, averaged etc. according to character and

potential

• Datahistorization

Data is stored at different periods and levels of detail according to age

ITBI™ OUTPUT:

The SMT/TransparencyGrid feeds the ITBI™ B.I. reporting and analysis

tool.

DATA SELECTION

Each IT platform has several logs for different system statistics. The

SMT/Dictionary is pre-configured to read only those with potential

benefit to ITBI™. This is the first and most obvious step in the mas-

sive data reduction necessary to handle the amount of data logged by

large IT installations.

The standard SMT/Dictionary settings can be altered to expand the

number of data feeds according to customer requirements.

Page 15: IT Business Intelligence Technical Overview

TECHNICAL OVERVIEW: IT Business Intelligence15

DATA FILTRATION

The amounts of collected data from the selected sources are dramati-

cally reduced by filtering out data fields (columns) with limited value

for ITBI™. The SMT/Dictionary is pre-configured to reduce all standard

data feeds this way. This complex and detailed selection is based on

SMT Data’s vast experience and is absolutely unique.

The standard SMT/Dictionary settings can be altered to expand the

number of selected columns according to customer requirements.

DATA REFINEMENT

The flexibility built into the SMT Dictionary makes it easy to include

information from customer or local data sources in order to refine and

add value to the standard input data, for example:

• Measurements indicating business volumes (i.e. number of new

accounts) can often be gathered from existing user applications and

are easily included in the standard SMT data flow. The added value

is obvious: capacity planning is done according to business volumes

and server load or cost can be reported per business process etc.

• AllSMTtoolsusetablestotranslatemeasuredtechnicallabelsinto

local naming conventions readily understood at all levels. In this

way user-IDs or server names may be converted to departments /

transaction or process names to applications / technical CPU- or

disk-units to monetary cost-units etc.

• Serversfromwhichdatamustbecollectedmaybedefinedmanu-

ally, but in larger installations it is easier to read the definitions

from an existing source e.g. asset or configuration management

database.

The list of data refinement examples could go on and on. Existing cus-

tomers have shown an incredible amount of creativity and innovation

in adding value to their ITBI™ solutions.

Page 16: IT Business Intelligence Technical Overview

IT Business Intelligence: WHITEPAPER 16

DATA AGGREGATION

Yet another way to reduce the initial amount of data is to abandon

the extremely small time intervals used for real time monitoring. SMT

tools are using intervals of 10 minutes to 1 hour for the most detailed

information. Experience shows that smaller intervals does not make

sense for ITBI™ solutions.

Measurements are summarized or averaged, and in many cases mini-

mum and maximum values are stored as well. Each single measure-

ment is treated according to pre-defined SMT/Dictionary rules based

on SMT Data’s vast experience. These standard rules are of course eas-

ily changed through the SMT/Dictionary.

In addition to time-based aggregation, SMT/Dictionary also supports

other forms of aggregation, such as aggregating together all the minor

processes, using below a certain resource threshold.

DATA HISTORIZATION

The last step in the massive data reduction controlled by the SMT/Dic-

tionary is the historization. As the stored information grows older, cer-

tain measurements are no longer useful - and even 1-hour intervals pro-

vide unnecessary detail after a while. The ITBI™ information is stored

at different levels of detail according to age. For each level, the SMT/

Dictionary controls the amount of detail and the retention period.

Page 17: IT Business Intelligence Technical Overview

TECHNICAL OVERVIEW: IT Business Intelligence17

Moving from reporting intervals of 1 hour to 1 day or even 1 month, as

the collected data ages, especially averaged values become meaning-

less. Introducing “time zones” solves this problem.

One zone could be the daily business peak, another the daily business

opening hours and a third would cover all remaining periods. In this

way sums and averages still make sense - and three values is stored per

day or month for each piece of information. SMT Data consultants assist

customers in evaluating and adjusting the default SMT/Dictionary set-

tings which control retention periods and time zones, according to local

customer requirements.

ITBI™ output

Standard input data is reduced to between 1/1,000 and 1/1,000,000 of

its original volume (depending on the data source). Few (if any) con-

ventional BI systems have to deal with volumes and reduction chal-

lenges of this magnitude. In fact, SMT Data’s large customers claim

that only SMT tools have been able to handle the amount of statistical

data created by their IT systems.

Page 18: IT Business Intelligence Technical Overview

IT Business Intelligence: WHITEPAPER 18

The massive data reduction is necessary in order to present a manage-

able data volume and data structure to the reporting and analysis tool.

Terabytes of raw data in complex structures are transformed to Mega-

bytes of useful information, stored in the SMT/TransparencyGrid.

The data model used for the SMT/TransparencyGrid was designed

with the necessary flexibility to properly support the inclusion of indi-

vidual and local information - both as measures and dimensions.

This allows information to be sought out and presented according to

customer specific naming conventions for organizational units, busi-

ness applications etc.

ITBI™reporting

The reporting is done through a genuine business intelligence inter-

face. This ensures the smart, user-friendly drag-and-drop report crea-

tion as well as drill-down and analysis possibilities, which modern

users of high-class reporting and analysis systems have grown accus-

tomed to.

The dynamic standard reports contain a number of pull-down-menus

displaying dimensions to choose from like time periods, organization-

al units or business applications etc. In this way one dynamic report

may correspond to hundreds of specific reports, according to individu-

al user selections from the pull-down-menus. This functionality solves

one of IT reporting’s most difficult challenges: it reduces the burden

of report creation and maintenance with several factors, leaving more

time to analyse the report information.

The following example shows how one cost report covers multiple

combinations of date intervals, business systems and environments:

TRANSPARENCY GRIDTRANSPARENCY GRID

Page 19: IT Business Intelligence Technical Overview

The time and skills

NOT needed always

come as a surprise

19 TECHNICAL OVERVIEW: IT Business Intelligence

Page 20: IT Business Intelligence Technical Overview

20 IT Business Intelligence: WHITEPAPER

EASY INSTALLATION

Page 21: IT Business Intelligence Technical Overview

TECHNICAL OVERVIEW: IT Business Intelligence21

SMT DATA’S ITBI™ TOOLS IT Business Intelligence (ITBI™) consists of products and

services. The products include:

HIGHLIGHTS

The actual installation of SMT software is a matter of hours, and full produc-

tion is then only 1 to 3 weeks away.

Data actuality and validity checks protect the SMT tools, and even the rare

error only requires a re-run of the affected data.

The use of ITBI™ from SMT Data constantly in-

spire users to create new valuable combinations of information from IT

and business.

FAST

SMOOTH

INSPIRATIONAL

IT BUSINESS INTELLIGENCE– THE TOOLBOX

Page 22: IT Business Intelligence Technical Overview

IT Business Intelligence: WHITEPAPER 22

SMT/ITBI™ FOUNDATION

The SMT/ITBI Foundation provides you with a web portal using BI

functionality to visualize the myriad of information, stored in the

SMT/TransparencyGrid, in a simple and manageable way. Each user

can create personalized reports by selecting combinations of dimen-

sions from drop-down menus.

With a few mouse clicks it is possible to move from overview to detail

through drill-down functions within the individual reports.

SMT PRODUCT SUITE

The SMT Product Suite is based on the SMT Data “Law Book”, which

describes how to collect, select, refine, aggregate and historize infor-

mation from IBM z/OS mainframe as well as Windows, VMware, UNIX,

and Linux; the unique reporting facilities creates a long-needed trans-

parency. Customers with outsourced IT operations benefit from the so-

lution by optimizing the outsourcing costs through “monitoring” the

provider’s optimization efforts.

ITBI™ Transparency Suite

Collects and historizes information from applications on all platforms

with a focus on resource consumption, bottlenecks, volumes per busi-

ness system. Combined with organizational input, cost distribution

policies and information from other SMT products this can be used to

distribute IT costs on business areas according to consumption of IT

resources. The result is a unique overview and transparency of IT usage

in your organization as a whole, in your business applications, for your

workload license charges and with regard to IT costs in general.

Page 23: IT Business Intelligence Technical Overview

TECHNICAL OVERVIEW: IT Business Intelligence23

PRODUCT INSTALLATION AND OPERATION

The time and skills NOT needed to install SMT tools always take new

customers by surprise. The actual software installation a few hours - the

customization needed to produce meaningful reports with local cus-

tomized naming conventions normally takes another 1 - 2 working days

depending on installation complexity and information availability.

The follow-on “test” period, which is actually used for verification of

local customization, sometimes lasts for up to 2 - 3 weeks. But SMT

tools are in full production 1 to 3 weeks after the product installation

begins. Daily operation is then smooth and stable. Even with local

customer additions, there are no problems with double updates,

missing data, handling of re-runs etc. Data actuality and validity

checks ensure high data quality. And should an error eventually oc-

cur, the affected update can simply be re-run without rollback or

other time consuming preparations.

SOLUTION MAINTENANCE AND DEVELOPMENT

Once an ITBI™ solution is in production, the transparency it creates

will inspire the various users to further exploit the enormous po-

tential of combining information from IT and Business. With flex-

ible input controls, superior data handling and smooth report

creation, SMT tools has led to many innovative local solutions in

cases where customers needed improved transparency. Mapping IT

measurements against business activity - or translating technical

units into cost units - makes the resulting information comprehen-

sible at all levels, virtually creating a common language for IT and

business. The diverse user base plays a major part in the success of

SMT Data’s ITBI™ solutions - depending on different organizational

units to keep “their” input (i.e. naming conventions) up to date

is no problem since they benefit from the resulting information

themselves.

Frequent addition of new customer-specific and value adding in-

novations does not go unnoticed. SMT solutions tend to become

Page 24: IT Business Intelligence Technical Overview

IT Business Intelligence: WHITEPAPER 24

central and recognized sources of transparency, overview and

insight with a high profile within the organization. Luckily, the

success is not too hard to handle since the on-going innovation is

possible with a surprisingly low effort through the central control

features of the SMT/Dictionary.

SMT DATA AS AN INDEPENDENT PARTNER

Many customers work closely together with SMT Data consultants

as the optimal way to assist or relieve local resources. And if local re-

sources are no longer at hand (often after outsourcing) it might be con-

sidered “smart-sourcing” to use SMT Data as an independent partner.

In order to optimize and standardize such customer requirements,

SMT Data has developed a range of ITBI™ Professional Services. The

ITBI™ services include:

• Productinstallation

• Productcustomization

• Productmaintenance

• Individualproductadd-ons

• Tasksourcing(individualtasksout-sourcedtoSMTData)

• Managedservices(entireprocessout-sourcedtoSMTData)

• PeriodicOptimizationAudits(SMTDatareviewsthecustomersite’s

cost saving or service optimization potentials and present the result

at a management level)

• ITBI™Implementation(selectedproducts,servicesandprocesses)

ITBI™ TIME LINE

An implemented ITBI™ solution is rarely static. Existing solutions are

expanded continuously according to the innovation it inspires among

its broad variety of users. However, the standard interfaces and setup

from SMT Data make sure that an ITBI™ solution will start proving its

worth already before the first full month of data collection.

CONTACT

HEAD OFFICE:

SMT Data A/SHarbour House

Sundkrogsgade 21 DK-2100 Copenhagen

Denmark

Phone: +45 3962 8887Fax:+45 3962 9687

Sales: [email protected]:[email protected]

Website: www.smtdata.com

SMT Data, Benelux:[email protected]

SMT Data, Denmark:[email protected]

SMT Data, Germany:[email protected]

SMT Data, Norway:[email protected]

SMT Data, Spain:[email protected]

SMT Data, Sweden:[email protected]

SMT Data, UK:[email protected]

Page 25: IT Business Intelligence Technical Overview

IT business intelligence creates complete transparency at the relation between IT and business.

And in the process it not only facilitates vast savings and huge going in efficiency. It also builds

a common language between people who speak in terabytes per second and those who see the

world in millions of Euros per quarter.

We have written and printed a magazine full of examples of what IT BI can help business achieve.

We’d love to send one, because it ‘s all good news