What's New Guide for 5.3.0

September 2018

What's New Guide for 5.3.0You can find the most up-to-date technical documentation at:

The Delphix Web site also provides the latest product updates.docs.delphix.comIf you have comments about this documentation, submit your feedback to: infodev@delphix.com

© 2018 Delphix Corp. All rights reserved.Delphix and the Delphix logo and design are registered trademarks or trademarks of Delphix Corp. in the United States and/or other jurisdictions.All other marks and names mentioned herein may be trademarks of their respective companies.

Delphix Corp.1400 Seaport Blvd, Suite 200Redwood City, CA 94063

1. What's New Guide for 5.3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41.1 Summary of 5.3 Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41.2 What's New for Toolkits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41.3 What's New for Splunk Integration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71.4 User Interface Enhancements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10

1.4.1 Table and Grid Improvements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101.4.2 Full Screen (Wizard) Improvements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111.4.3 Container List Improvements . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 12

1.5 What's New for Masking Engines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14

What's New Guide for 5.3.0 © 2018 Delphix

What's New Guide for 5.3The What's New Guide for the Delphix Dynamic Data Platform gives you a quick, convenient overview of new functionality, enhanced features,and new documentation for the 5.3 release. For more information about each feature discussed in this guide, links are provided in each newfeature description, taking you to topics that contain additional information and steps. We highly recommend that you read the topicslinked from the topics in this guide, before undertaking complex operations with the Delphix Dynamic Data Platform. 

This guide covers the following topics:

 Summary of 5.3 FeaturesWhat's New for ToolkitsWhat's New for Splunk IntegrationUser Interface EnhancementsWhat's New for Masking Engines

Summary of 5.3 FeaturesThis page offers a brief summary of the new features for the Delphix Dynamic Data Platform. For more details, see the links in the tables below.

Summary of 5.3 Major New Features

Following are the major new features introduced in the Delphix Dynamic Data Platform.

Major New Features

Feature What's New MoreInformation inthis guide

DelphixDocumentation

ContinuedUserExperienceImprovements

Delphix now provides an end-to-end Provision VDB wizard that allows you to pick a dSource or VDB,choose a snapshot or point in time, then provision a VDB all within a single flow. The Data objects listhas also been redesigned, making it easier for users to understand at a glance which datasets belongin which groups.  User terminology for "Delphix Admin" has been changed to "Engine Admin".

User InterfaceEnhancements

DelphixVirtualizationUser Interface

Masking Job Sync: Users are able to specify the masking jobs they would like to synchronize, this includes allof the necessary connectors and rulesets. In addition, users are able to easily synchronize universalsettings (including algorithms, domains, and more).Masking APIs: In the 5.3 release, we have introduced APIs for Users & Roles and Algorithms. Thisbuilds on the Masking APIs for managing jobs, environments, profiling, etc. that were part of the 5.2release.

What's Newfor MaskingEngines

MaskingDocumentation

SplunkIntegration

The Delphix Virtualization Engine supports integration directly with Splunk to send logs, events, andmetrics to your Splunk instance. This integration will help you monitor and understand the health of yourDelphix Engines using one of the most popular application monitoring tools.

What's Newfor SplunkIntegration

SplunkIntegration

Summary of 5.3 Additional New Features

Following are several additional new features and enhancements introduced to the Delphix Engine version 5.3.

Additional New Features

Feature What’s New Delphix Documentation

ExpandedSelf-ServiceControl

Added the ability for Delphix self-service users to restore to points prior to when aSelf-service template was initially created. This allows increased control and flexibility for endusers who want access to all the data that exist in their containers.

Understanding Timelines andHow to Preserve Data in aPoint in Time

SQL ServerManualDiscovery

Support for the manual discovery of single-instance SQL Server database hosts.  Manual Discovery for SQLServer Instances

ToolkitManagement

Added the ability to edit toolkits using Toolkit Management via the Delphix Managementinterface eliminating the use of scripts.

Toolkit Management

What's New Guide for 5.3.0 © 2018 Delphix

1. 2.

3.

What's New for Toolkits

With the 5.3 release, users can directly upload their Toolkits to the Delphix Management application with a single click, thus eliminating theprocess to upload Toolkits using scripts. Toolkit upload via the Delphix Management application helps users to build their Toolkit library in asimple and easy to use manner. 

The Toolkit screen allows users to view a structured or formatted view of their selected Toolkit and it provides a single click option for users todelete a Toolkit. 

Accessing the Toolkit Screen

Login to the application as a delphix_admin.  Delphix Management Select  .Manage > ToolkitsThis opens the Toolkits screen.

The Toolkits screen provides information about the selected Toolkit.  Included here are lists of data sources and repositories that areassociated with the selected Toolkit.

Only Admin users are able to upload or delete Toolkits. Standard users are only able to view Toolkit information.

What's New Guide for 5.3.0 © 2018 Delphix

1. 2. 3.

4.

5.

1. 2. 3.

4.

Allows Delphix_admins to add or upload a toolkit.

Allows Delphix_admins to delete a toolkit.

Adding a Toolkit

To add or upload a new Toolkit complete the instructions below:

Login to the application as a . Delphix Management  delphix_adminSelect  .Manage > ToolkitsTo add or upload a Toolkit, click the 

icon. This opens the Upload or Upgrade Toolkit dialog. 

To upload or upgrade the Toolkit,  browse to your file and drop it onto the screen or drag and drop the file onto the screen.

 Click   when done.Close

Deleting a Toolkit

To delete a Toolkit:

Login to the application. Delphix Management Select  .Manage > ToolkitsSelect the Toolkit and click the Delete icon.

Click Delete to confirm deleting the Toolkit and its related data.

What's New Guide for 5.3.0 © 2018 Delphix

1. 2. 3. 4.

1. 2.

Related Links

Delphix Engine Toolkit Management

What's New for Splunk Integration

self-monitoring/diagnosability of Delphix Engines by providing native integration with Splunk Enterprise. This new feature enables  By providingdetails about your Splunk instance, you can allow Delphix Engine(s) to automatically send structured JSON logs to Splunk that capture activity on

 These logs include Delphix events (Actions, Job Events, Faults, and Alerts) as well as performance metrics (CPU, disk,those Delphix engine(s).network, TCP, dataset, NFS, iSCSI) and capacity metrics.  enables extensible search and visualization of actionable information andThis featureprovides a centralized, comprehensive view of Delphix activity (including the ability to cross-reference information from multiple Delphix engines)on a platform that allows building your own operational intelligence for your Delphix installation.

Prerequisites

Before you configure the Delphix Engine you will need to configure and make a note of the following in Splunk:

In the Splunk web  (this is optional but best practice for security) in your global HTTP Event Collector (HEC) settings.UI Enable SSL The or . Splunk hostname   IP AddressThe   number for your Splunk instance (default 8088).HEC PortEnable the HTTP Event Collector on Splunk, and create a new   with a new Splunk index set as an allowed index for theHEC Tokentoken. Make sure  is   for the token.Enable Indexer Acknowledgement  unchecked

Note the   and the   for the token.HEC Token Value Allowed Indexes

Configuring Delphix for Splunk

Log in to the   as the sysadmin.Delphix Server Setup UIFrom the   menu select  .Preferences Splunk Configuration

Please refer to the Splunk documentation for detailed steps on how to configure your values.

If you wish, you can use a separate Splunk index for performance and capacity metrics (otherwise, the same indexwill be used for both events and metrics). If you are using Splunk 7.0+, it is recommended that you create thissecond index as a special “Metrics” type index that is optimized for indexing and searching metrics data.

What's New Guide for 5.3.0 © 2018 Delphix2.

3. In the Splunk, Configuration window, enter your Splunk values. To reduce the volume of data that will be sent to Splunk, you can optionally uncheck Enable Metrics.

Host Splunk hostname or IP address

HEC Port The TCP port number for the Splunk HTTP Event Collector (HEC)

HEC Token The token for the Splunk HTTP Event Collector (HEC)

Main Index The Splunk Index events will be sent to. Must be set as an allowed index for the HEC token.

Events PushFrequency

The frequency at which the Events will be pushed to Splunk. Specified in seconds.

Enable SSL Whether to use HTTPS to connect to Splunk. Must match your HTTP Event Collector settings in Splunk.

What's New Guide for 5.3.0 © 2018 Delphix

3.

4.

5.

Metrics Index The Splunk Index metrics will be sent to. If none is specified then the Main Index will be used for metrics as well.Must be set as an allowed index for the HEC token.

Metrics PushFrequency

The frequency at which the Performance Metrics will be pushed to Splunk. Specified in seconds

Performance DataGranularity

The resolution of performance metrics data sent to Splunk. This controls how frequently snapshots of systemperformance data are taken.

Click Send Test Data to verify your provided values. This will send a test event to the provided token and indexes.Click Save to enable the Splunk configuration and begin sending all new Actions, Job Events, Faults, Alerts, and Metrics to your Splunkinstance.

Using Search

Use the search to analyze your data and enumerate items in a metrics index. For more about searching a metrics index, refer to the Splunk documentation.

Search Examples - MetricsThe following examples provide information on viewing Metrics on Splunk 7.x

To get a list of all Metrics:

| mcatalog values(metric_name)

To get a list of all dimensions of a given metric - say CPU utilization percentage:

| mcatalog values(_dims) where metric_name="system.cpu.util.pct"

To view the average values of overall CPU utilization percentage across all hosts with a span of 30 seconds:

| mstats avg(_value) WHERE index=delphix_metrics ANDmetric_name=system.cpu.util.pct span=30s

You can also display results in a chart with CPU wildcard:

| mstats perc85(_value) AS val85 avg(_value) AS val wheremetric_name="system.cpu.*" span=1s by data.kernel, data.user, data.idle| eval total='data.kernel' + 'data.user' + 'data.idle'| eval sys_pct=(('data.kernel'/total) * 100) | eval usr_pct=(('data.user'/total) * 100) | eval idle_pct=(('data.idle'/total) * 100) | timechart span=10m avg(val) as "cpu.overall", avg(val85) as "cpu.overall85th Percentile", avg(sys_pct) as "cpu.system", avg(usr_pct) as "cpu.user",avg(idle_pct) as "cpu.idle"

This type of search can be used to stack different CPU metrics that add up to 100%. Here is a sample screenshot of the above “stack differentCPU metrics” from the Delphix Engines.

What's New Guide for 5.3.0 © 2018 Delphix

Related Links

Splunk IntegrationConfiguring SplunkUsing Search

User Interface Enhancements

The Delphix Management interface is continually being redesigned to improve usability.  The following pages highlight and walk you through thechanges providing you with more details:

Container ListsTable/GridsFull Screen Wizards

Table and Grid ImprovementsThe   screen now has an improved table format. This interface makes it easier to identify which datasets areStorage Capacityconsuming the most space on your Delphix Engine. It also helps you quickly assess how much storage would become available from deletingselected dSources, VDBs, or snapshots.The table has been modified for ease of use:

 Table framing has been lightened to allow the data to standout.

 Column separators have been made lighter.

What's New Guide for 5.3.0 © 2018 Delphix

1. 2. 3. 4.

5.

The filter on the Storage Capacity screen will allow you to filter the datasets.Use of gradients has changed.Removed sort-ability of columns. 

Related Links

An Overview of Capacity and Performance Information

Full Screen (Wizard) ImprovementsIn prior releases, wizards were displayed as a modal dialog on top of another screen hiding the real estate of the screen behind it. In 5.3 all thewizard screens are more spacious covering the entire screen, thus letting users focus on the task at hand.

New End to End Provision VDB Wizard

In 5.3 Delphix now provides a new end to end provisioning wizard, which means users do not have to select a dsource and then pick apoint-in-time to provision from. With this new wizard, you can complete all the VDB provisioning tasks from one location. The following stepsprovide an example of  the new VDB wizard:

Login to the application. Delphix Management Select  .Manage > DatasetsClick the   icon.plusSelect . Provision VDBThe Preparation screen provides an overview of what you will need to do.

Select to Continue.Next

What's New Guide for 5.3.0 © 2018 Delphix

5.

6. 7.

8. 9.

10. 11.

The Source screen allows users to select a dSource or VDB to provision from.

Select to Continue.NextIn the Provision Point screen, users can select to provision from a Snapshot, a Point in time, or System Change Number (SCN).

In this example, we want to provision from a Point in Time so we will select More Accurate and then select .NextIn the Point in Time screen users can select a specific point in time or open a log file and then make their selection. This works just as italways has.Once you have made your selections click .NextFrom this point on the Provision VDB wizard steps have not changed.

Container List ImprovementsAs shown below the Datasets container list has been updated to improve readability.

What's New Guide for 5.3.0 © 2018 Delphix

 Ability to filter is visually less noisy providing users with the ease of use.

Visually more organized with the ability to or  .Expand All Collapse All        Expand All expands the available environments where Collapse All, provides only the top level environments and without the details.

 Indents reinforce hierarchy.

Introduced new icons: For example, the dSource icon has now been changed. 

  

 Solid database icon that represents the connection to the physical database and the waves reflect projection.

What's New Guide for 5.3.0 © 2018 Delphix

  

 VDB icons have been modified to become more open and lighter.

 

 Icons for physical databases have also been updated to be lighter and more open.

The icons located at the top of each page have also been cleaned up and made lighter.

Error bars (red and yellow) have been replaced with new icons that tell users an error needs to be addressed.

Related Links

Delphix Virtualization User Interface

What's New for Masking Engines

Synchronizing Masking Jobs & Universal Settings Across Engines

In 5.2 we introduced the ability to synchronize Masking Algorithms between engines to ensure consistent masking, regardless of the engineexecuting the masking. In 5.3 are expanding the list of syncable objects to include:

Masking JobsConnectorsRulesetsDomainsFile Formats

The sync of objects is possible through improvements to several sync API endpoints, including:

GET /syncable-objects[?object_type=<type>]POST /exportPOST /export-asyncPOST /importPOST/import-async

This expansion of syncable objects ensures that users can sync their Masking Jobs and all the objects necessary for that masking job to executesuccessfully - regardless of the masking engine it lives on, allowing for easier scaling of Delphix Masking across the enterprise. Please see Managing Multiple Masking Engines for more details.

Support for Kerberized Connections

In 5.2.4 we added support for Kerberos for our Oracle Masking Connector. In 5.3 we have expanded the list of connectors that support Kerberosto:

SQL ServerSybase

To enable Kerberized connectors your engine must be configured properly and you must configure your masking Connectors for Kerberos.Kerberos can be enabled by going to the Advanced mode on Oracle, SQL Server and Sybase. Please see  Managing Connectors for more details.

What's New Guide for 5.3.0 © 2018 Delphix

New API Endpoints

In 5.2 we released an all-new set of API endpoints allowing for the automation of many masking workflows. In 5.3 we have expanded this list ofAPI endpoints around Algorithms, Users, Roles, File Upload, System Information, Login, Rulesets, and Connector. Below are the net new APIendpoints:

Group Endpoint Description

Algorithms

POST /algorithms Create algorithm

DELETE /algorithms/{algorithmName} Delete algorithm by name

GET /algorithms/{algorithmName} Get algorithm by name

PUT /algorithms/{algorithmName} Update algorithm by name

PUT /algorithms/{algorithmName}/randomize-key Randomize key by name

Users

GET /users Get all users

POST /users Create user

DELETE /users/{userId} Delete user by ID

GET /users/{userId} Get user by ID

PUT /users/{userId} Update user by ID

Roles

GET /roles Get all roles

POST /roles Create role

DELETE /roles/{roleId} Delete role by ID

GET /roles/{roleId} Get role by ID

What's New Guide for 5.3.0 © 2018 Delphix

PUT /roles/{roleId} Update role by ID

Rulesets

PUT /database-rulesets/{databaseRulesetId}/bulk-table-update Update the rule set’s tables

PUT /database-rulesets/{databaseRulesetId}/refresh Refresh the rule set

Connectors

POST /database-connectors/{databaseConnectorId}/test Test a database connector

POST /database-connectors/test Test an unsaved database connector

POST /file-connectors/{fileConnectorId}/test Test a file connector

POST /file-connectors/test Test an unsaved file connector

Async Tasks

GET /async-tasks Get all asyncTasks

GET /async-tasks/{asyncTaskId} Get asyncTask by ID

PUT /async-tasks/{asyncTaskId}/cancel Cancel asyncTask by ID

File Upload/Download

DELETE /file-uploads Delete all file uploads

POST /file-uploads Upload file

GET /file-downloads/{fileDownloadId} Download file

System Information GET /system-information Get version, etc.

Login/Logout PUT /logout User logout

Executions GET /execution-components Status for a table, file, or VSAM file

In addition to the net new API endpoints, we have improved pre-existing API endpoints. Some of the improvements include:

Addition of DB2 iSeries & Mainframe to connector endpoints.Addition of Kerberos configuration on Oracle, SQL Server & Sybase connectorsAbility to have ruleset refresh drop tablesSupport for XML file typesAddition of dataType to column metadata

For more information please on Delphix Masking APIs please see . API documentation Please note that the previous generation of Masking APIs(commonly referred to as V4) is EOL and no longer supported in this release. All users are encouraged to migrate to the V5 APIs.

Related Links

Managing ConnectorsManage Multiple Engines for MaskingMasking APIs