qvd metadata profile app in qlik sense

Post on 09-Jan-2017

207 Views

Category:

Technology

2 Downloads

Preview:

Click to see full reader

TRANSCRIPT

www.syntrixconsulting.com

QVD Metadata Profile App

In Qlik Sense®

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749)

About Syntrix

2

Syntrix Consulting Group specializes in data reporting and business

analytics for healthcare organizations.

We provide tools, processes, and expertise to accelerate the production and adoption of analytic applications

in healthcare.

We are a Qlik Implementation Partner with expertise in multiple EMR

systems including Epic.

877-SYNTRIX (796-8749)BIAdvisors@syntrixconsulting.com

www.syntrixconsulting.com

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749)

Importance of MetadataQVD Environment OverviewStep 1: Create Qlik Sense AppStep 2: Retrieve QVD MetadataStep 3: Store Metadata into QVDsStep 4: Create Field Level Business DefinitionsStep 5: Create Qlik Sense Metadata QVD

Profile App

Overview

3

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 4

What is metadata?• It is the detail about the data in your environment. • It provides insight about what the data stands for

and where it came from• It can be considered the encyclopedia about your

dataWhy is it important?

• Data Linage – the metadata can provide the details on where the data was sourced and how it was curated

• Data Impacts – the metadata can provide details on how changes made in a source system will affect downstream artifacts

Importance of Metadata

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 5

The QVD Environment has a directory for each data source

Each directory has numerous QVDs stored in them

QVDs stored in here are created with extract applications

QVD Environment Overview

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 6

From the Qlik Sense hub create new app called QVD Metadata

Open AppOpen Data Load Editor

Step 1: Create Qlik Sense App

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 7

Create a script to read the metadata from each QVD in a specified directory and then store that information into a QVD.

The following two Qlik Load features will be used• XMLSimple-QVDTableHeader – this will read the QVD

table information

• XMLSimple-QVDFieldHeader – this will read the QVD field information

Step 2: Retrieve QVD Metadata

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 8

2A. Define location and variables for script

Step 2: Retrieve the QVD Metadata

This line defines where the QVDs are located and the file types you

want to iterate through

This line creates a variable that stores the name of the QVD file

for each iteration

This line defines the name from where the QVD was sourced.

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 9

2B. Read the table header information from the QVDs

Step 2: Retrieve QVD Metadata

This will create a table and load table-level metadata from the QVD into it

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 10

2C. Read the field information from the QVDs and Iterate through the directory for the next QVDs

Step 2: Retrieve QVD Metadata

This will create a table and load field-level metadata from the QVD into it

Next will iterate back to the for each statement and

retrieve the next QVD

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 11

Create a directory location and store the tables in step 2 in this location

Use the Store command to create the metadata QVDs

Step 3: Store Metadata into QVDs

The last two statements will Store table data into QVDs in the

00.QVDProfile folder

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 12

To add value for your business teams it is useful to create field definitions and associate them to the QVD field definitions

You can capture these definitions where you please (xls, Access, Database…), but will need to linked them to vFileName – FieldName Dictionary_id created in steps 2 and 3

Below is an example of a field dictionary in Excel It is recommended to create a QVD of the

dictionary

Step 4: Create Field Level Business Definitions

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 13

Now you have all of the components to create a QVD Profile Application

Go to the Qlik Sense HubLoad the three QVDs and your Data Model will

look like this:

Step 5: Create Qlik Sense QVD Profile App

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 14

Now you can start creating dashboards about your data which will provide insight and confidence for your end users.

Step 5: Create Qlik Sense QVD Profile App

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 15

With this concept you can profile many QVD directories with minor script changes

You can read in the INFORMATION_SCHEMA from SQL Server and Oracle and add rich metadata into your QVD environment

If you have many levels to your data environment your can create linage scripts to create a robust metadata rich Qlik Sense environment

Additional Notes

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 16

To learn more, contact us at:877-SYNTRIX (796-8749)

BIAdvisors@syntrixconsulting.comwww.syntrixconsulting.com

Syntrix Consulting Group

top related