qvd metadata profile app in qlik sense

16
www.syntrixconsulting .com QVD Metadata Profile App In Qlik Sense®

Upload: syntrix-consulting-group

Post on 09-Jan-2017

207 views

Category:

Technology


2 download

TRANSCRIPT

Page 1: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com

QVD Metadata Profile App

In Qlik Sense®

Page 2: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749)

About Syntrix

2

Syntrix Consulting Group specializes in data reporting and business

analytics for healthcare organizations.

We provide tools, processes, and expertise to accelerate the production and adoption of analytic applications

in healthcare.

We are a Qlik Implementation Partner with expertise in multiple EMR

systems including Epic.

877-SYNTRIX (796-8749)[email protected]

www.syntrixconsulting.com

Page 3: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749)

Importance of MetadataQVD Environment OverviewStep 1: Create Qlik Sense AppStep 2: Retrieve QVD MetadataStep 3: Store Metadata into QVDsStep 4: Create Field Level Business DefinitionsStep 5: Create Qlik Sense Metadata QVD

Profile App

Overview

3

Page 4: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 4

What is metadata?• It is the detail about the data in your environment. • It provides insight about what the data stands for

and where it came from• It can be considered the encyclopedia about your

dataWhy is it important?

• Data Linage – the metadata can provide the details on where the data was sourced and how it was curated

• Data Impacts – the metadata can provide details on how changes made in a source system will affect downstream artifacts

Importance of Metadata

Page 5: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 5

The QVD Environment has a directory for each data source

Each directory has numerous QVDs stored in them

QVDs stored in here are created with extract applications

QVD Environment Overview

Page 6: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 6

From the Qlik Sense hub create new app called QVD Metadata

Open AppOpen Data Load Editor

Step 1: Create Qlik Sense App

Page 7: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 7

Create a script to read the metadata from each QVD in a specified directory and then store that information into a QVD.

The following two Qlik Load features will be used• XMLSimple-QVDTableHeader – this will read the QVD

table information

• XMLSimple-QVDFieldHeader – this will read the QVD field information

Step 2: Retrieve QVD Metadata

Page 8: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 8

2A. Define location and variables for script

Step 2: Retrieve the QVD Metadata

This line defines where the QVDs are located and the file types you

want to iterate through

This line creates a variable that stores the name of the QVD file

for each iteration

This line defines the name from where the QVD was sourced.

Page 9: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 9

2B. Read the table header information from the QVDs

Step 2: Retrieve QVD Metadata

This will create a table and load table-level metadata from the QVD into it

Page 10: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 10

2C. Read the field information from the QVDs and Iterate through the directory for the next QVDs

Step 2: Retrieve QVD Metadata

This will create a table and load field-level metadata from the QVD into it

Next will iterate back to the for each statement and

retrieve the next QVD

Page 11: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 11

Create a directory location and store the tables in step 2 in this location

Use the Store command to create the metadata QVDs

Step 3: Store Metadata into QVDs

The last two statements will Store table data into QVDs in the

00.QVDProfile folder

Page 12: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 12

To add value for your business teams it is useful to create field definitions and associate them to the QVD field definitions

You can capture these definitions where you please (xls, Access, Database…), but will need to linked them to vFileName – FieldName Dictionary_id created in steps 2 and 3

Below is an example of a field dictionary in Excel It is recommended to create a QVD of the

dictionary

Step 4: Create Field Level Business Definitions

Page 13: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 13

Now you have all of the components to create a QVD Profile Application

Go to the Qlik Sense HubLoad the three QVDs and your Data Model will

look like this:

Step 5: Create Qlik Sense QVD Profile App

Page 14: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 14

Now you can start creating dashboards about your data which will provide insight and confidence for your end users.

Step 5: Create Qlik Sense QVD Profile App

Page 15: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 15

With this concept you can profile many QVD directories with minor script changes

You can read in the INFORMATION_SCHEMA from SQL Server and Oracle and add rich metadata into your QVD environment

If you have many levels to your data environment your can create linage scripts to create a robust metadata rich Qlik Sense environment

Additional Notes

Page 16: QVD Metadata Profile App in Qlik Sense

www.syntrixconsulting.com | 877.SYNTRIX (877.796.8749) 16

To learn more, contact us at:877-SYNTRIX (796-8749)

[email protected]

Syntrix Consulting Group