data-ed: emerging trends in data jobs

Emerging Trends in Data Jobs

Peter Aiken, PhDMehmet Orun, CDMP

Eva Smith, CDMP1

Panelist Introductions:Different Backgrounds Coming Together

I want to find the best people I can hire, and the best ways I can continue to develop them through their career, while advising my consulting clients how they can do the same

As an educator and mentor, I want to be able to advise students who are mid-level professionals into data management careers and help them to be successful

Mehmet Orun, CDMPDirector, Data SolutionsSalesforce.com

Eva Smith, CDMPDirector of IT and eLearningEdmonds Community College

I am very concerned with raising the profile of our sole, non-depletable, non-degrading, durable, strategic asset within organizations

Peter Aiken, PhDFounding Director, Data BlueprintAssociate Professor, VCUPast President DAMA International

2

We want to enable “Intentional Development”

Programs to develop the individuals

Framework for finding the best development paths

Basic Data Management Principles

Job Titles & Roles

Working with Data Enabling Data in Systems

Specify/Govern Design

Use/Maintain Build

Analyze Store/Secure

Title/Role Scope Planning Horizon

Operational Analyst

Daily Transactions

Daily - < 3 months

Data Architect … 1-3 years

Chief Data Officer

… 5+ years

Main Duties Primary Tasks

Data Modeling Define Scope, Write Definitions, …

Data Analysis Identify DQ Metrics…

Data Governance ID Responsible Partiy, Manage Change, …

3

What is the Data Profession and Why is it So Hot?

4

Why is the Data Profession so Hot?(It is not just about “Data Scientists”)

Source: EMC2 Big Data Study

5

Why is the Data Profession so Hot?(It is not just about “Data Scientists”)

6

There are many roles and career paths

Other

Data Profession

Starting Points Specialized and Senior Roles

Support Specialist

Developer

Business Analyst

Data Steward

Privacy/Compliance Specialist

Database Designer

Data Analyst

Data Governance Manager

Data Modeler

Chief Info Security Officer

Chief Data Officer

Data Architect

System Administrator

7

How does someone get into this profession?

This is an ‘elusive’, often mid-career profession, without clear entry points and training paths

Technical training is easy. To be good or effective, it is about aligning skills and passion, with effective mentoring

Yes, but what do I tell someone who is just getting started?

And how can we institutionalize the knowledge skills and abilities transforming this from a craft to a recognized profession

8

Typical Answers from DM Professionals

How I got into this career...• I just fell into this role • An opportunity came along in my company• Another data professional was a mentor to me• I found a professional association (DAMA, TDWI) and

started attending meetings, classes, webinars and conferences.

• I took a class that sparked my interest and decided to learned more on my own

• I've been in IT for 10+ years and had an epiphany that if we got the data right then a lot of other aspects of IT would become easier

9

Not So Typical...

• A college or high school career advisor steered me toward this profession

• I pursued a college degree in data management and got a job

• I found a job description in the Department of Labor Occupational Handbook or other online career guidance site

10

The “Elusive” Data Management Career

Work + other IT experience

vs. direct from college

??

Principal Analyst / Enterprise Architect

Manager / Executive In 2006, based on the results of a DAMA International survey, typical data management professional was:● ~45 years old● Had ~20 years of work experience with ~12

years working with data● Typically began a professional career in

mid-twenties, joined the data management field about 8 years later

In 2013, demographics evolved● Strata Big Data conference dominated by

mid 20s-late 30s analyst/developers● Analytics emphasis attract talent from

management and hard sciences● Academic programs continue to evolve,

and allow earlier entry to the field

11

The Classification Problem…

What do we want to be when we grow up…. 12

Many roles, specializations, titles….Or on business cards…

Information ArchitectInformation Quality Program ManagerInformation Resource AnalystInformation SpecialistInformation Support ManagerInformation Systems AnalystIT Project LeadIT Project ManagerIT ArchitectIT ConsultantData AnalystData ScientistFinancial Data AnalystOperations Data AnalystCompliance AnalystCompensation Analyst…

13

Roles are about what we want to doand with what we want to work

14

Working with Data Enabling Data in Systems

Specify/Govern* Data Governance Manager* Compliance Specialist

Design* Data Modeler / Database Designer / SOA Architect* Data Architect* Information Architects (i.e. presentation of information)

Use/Maintain* Data Steward

Build* Integration Developer (ETL, EAI, EII, B2B, DW, MDM…)* Application Developer* Reporting & BI Developer (Metrics, Dashboards…)

Analyze* Data (in general)* Data (in specific context, e.g. Finance)

Store/Secure* DBA* Security Admins

What are your top two natural interest and tendencies?

Sample of reported job titles from O*Net Occupational Handbook: Database Administrator (DBA), Database Analyst, Database Administration Manager, Database Coordinator, Database Programmer, Information Systems Manager, Management Information Systems Director (MIS Director), Programmer Analyst, Systems Manager

O*Net Occupational HandbookWhile roles maybe common, common title

definitions still lag behind…

10 years ago…

15

“Newer” Data Related Job Categories

Today

O*Net Occupational Handbook… even after the recent evolution and expansions

16

We are not there yet

“Design strategies for enterprise database systems and set standards for operations, programming, and security. Design and construct large relational databases. Integrate new systems with existing warehouse structure and refine system performance and functionality.

Database Architect: “This title represents an occupation for which data collection is currently underway.”

17

So how does someone intentionally prepare for this career?

Abilities (my dependable strengths)

Knowledge (what I know)

Skills (what I can do)

18

Preferred attributes required of the typical Data Management Professional*

*From Facilitated Workshop on the Data Management Profession, December 6, 2013, Edmonds Community College

Blue = most important aptitudes for the DM Professional

Works Independently

Can see the big picture

Sees patterns and relationships

Good organizer of information

Good listener

Good with words

Thinks visually

Inquisitive

Self Confident

Can handle ambiguity

Is “thick skinned”

Markets well

Can work through a problem to a solution

Self motivated

Analytical yet creative in problem solving

Communicates well

Articulate and friendly

Oriented more toward business than technical matters

Abilities

19

Recommended Knowledge Areas for Data

Professionals


Knowledge

20

Preferred Core Skill Sets for Data Management

Professionals


Skills

21

Work Profile

*From Facilitated Workshop on the Data Management Profession, December 6, 2013, Edmonds Community College 22

Information Technology

Enterprise Architecture

(EABOK)

Business Analysis (BABOK)

Project Management

(PMBOK)

Business/Industry Knowledge

Data Management(DAMA-DMBOK)

Multiple Knowledge Domains

23

How do I get hired into this Career?What are my Growth Paths?

Attributes (my dependable strengths)



Understand the Role



Understand the

Expectations

Understand how the role can Evolve

24

Sample Job Profile: Data Analyst

Data Analyst is a data professional who analyzes content against information expectations or specifications, looks for patterns of conformance or deviation, and seeks to identify ways of building new rules, insights, metrics, data improvement approaches.

Data Analyst is a data professional who analyzes content against information expectations or specifications, looks for patterns of conformance or deviation, and seeks to identify ways of building new rules, insights, metrics, data improvement approaches.Source: Data Management Association (DAMA) Dictionary of Data ManagementSource: Data Management Association (DAMA) Dictionary of Data Management

Typical Academic Background:

Computer ScienceInformation SystemsManagement Information SystemsInformation and Communications TechnologyMathematics

Other Academic Background/Career Paths Include: Business History Science …

25

Data Analyst Levels and TitlesTypical Title Typical Role

Associate Data Analyst / Operations Analyst

Operational monitoring and support, execution of pre-determined tasks. Conducting research against well defined data sets.

Data Analyst / [Functional Area] Analyst

Data profiling and analysis against new data sets or scenarios looking for patterns in response to business needs. Data set comparisons for inconsistency and quality identifications. Scripts to format data for improved processing.

Senior Data Analyst


Lead Data Analyst / Data Scientist

Defining detailed, end-to-end data quality management and improvement processes for one or multiple solutions. Driving requirements for metrics and data quality improvement areas, as well as comprehensive evaluations of different improvement techniques. Coordination and mentoring of other analysts.

Principal Data Analyst / Senior+ Data Scientist

Defining detailed, end-to-end data quality management and improvement processes for one or multiple solutions. Driving requirements for metrics and data quality improvement areas, as well as comprehensive evaluations of different improvement techniques. Coordination and mentoring of other analysts.

26

Typical Role

Demonstrated BehaviorKey Skills

Sample: BI Need

Sample: DQ Need

Operational monitoring and support, execution of pre-determined tasks. Conducting research against well defined data sets.Disciplined execution, consistent results, timely escalations

Data aggregation through spreadsheets, use of WYSYIG reporting or query tools, simple SQLCreates reports against pre-defined metrics, aggregations or calculations against pre-defined tables against specific business questionsRun monitoring scripts, identify key area of concern, report on trends

Associate Data Analyst

27

Typical Role

Demonstrated Behavior

Key Skills

Sample: BI Need

Sample: DQ Need


Ability to own and drive data quality and test assessment for a a feature across data sources, understanding how each hand off point may impact content.

Complex SQL and scripting. Advanced analytics and aggregations for trends research and deviation analysis. Ability to define formulas to test business rules of increasing complexity against thresholds, define alerts.

Develop data driven formulas that will act on trends, supported by alerts to notify stakeholders when significant deviations occur. Translate business metrics into actionable, technical metrics.

Develop database tables and associated scripts to capture data as well as metadata to support trend analysis. Effective design would demonstrate automation code to be able to run on the metadata for sustained operations.

Senior Data Analyst

28

Hiring and Promoting Resources

Increasingly more about Skills and Consistently Demonstrated Behavior

vs.

# of years of experience, list of projects

Soft Skills matter!!- Interviewing- Listening- Telling Data Stories(see Attributes slide for more examples)

29

What about more senior roles?

30

Copyright 2013 by Data Blueprint

Requisite (Natural) Order Organization Principles

31

Adapted from Elliott Jaques Levels Theory and other materials from http://globalro.org

RO Level

Organizational Title

Data Professionals

Titlein charge

of ...Planning Horizon

7 CEO Global Organization 20+ years

6 EVP Multi-Business Organization

10 - 20 years

5President/ Managing Director

Business Unit 5 - 10 years

4 VP/General Manager

Organizational Unit 2 - 5 years

3Director/

Department Manager

Department Evolution/

Optimization< 2 years

2 (often first) Line Manager

Operational Function < 1 year

1 Front Line/ Operator

Prescribed Function < 3 months

RO Principles ...• Patterns of language moving from

the concrete to higher and higher levels of abstraction

• Approaches to problem solving moving through: declarative – cumulative – serial – parallel

• Changes in the number of functions/areas of knowledge that needed to be understood in making a decision (few going to many)

• Thanks to Ken Sheppard, PhDPresident, Global Organization Design Society


Data Management Career Titles

32

RO Level


Data Professionals Title

in charge of ...

Planning Horizon

7 CEO n/a Global Organization 20+ years

6 EVP Chief Data Officer

Organizational Data Governance

BU/Process Data Governance

Multi-Business Organization

10 - 20 years

5President/ Managing Director

Chief Data Officer


BU/Process Data Governance

Business Unit 5 - 10 years


Deputy CDODepartment Data

GovernanceEnterprise Architect


3Director/

Department Manager

Data DirectorChief Data StewardPortfolio Architect



2 (often first) Line Manager

Data ManagerData Modeler

Operational Function < 1 year

1 Front Line/ Operator Data Steward Prescribed

Function < 3 months

Managers of ...• Data architects• Data engineers• Data designers• Database designers• ETL specialists• Model Curriculum Framework

Clusters?– Business and Systems Analysts– Data Warehouse Specialist– Data Analysis or Data Modeling– Database Administration and

Development– Project Management– Quality Assurance / Test Analyst– Technical Trainer or Writer– Data Architect or Administrator

Evolutions in Education

33

Attempt to engage academia:DAMA Curriculum Framework (2005)

34

Recent Academic Trends: More Curriculum Frameworks (2012)

http://library.umassmed.edu/data_management_frameworks.pdf

35

Academic Trends: Masters Degree and Certificate Programs

http://www.informationweek.com/big-data/big-data-analytics/big-data-analytics-masters-degrees-20-top-programs/d/d-id/1108042?

PACE-IT Certificate in Data Management

(Being Developed through a US Department of Labor Grant)

36

Academic Trends:Career Guidance

http://education-portal.com/articles/Data_Management_Analyst_Job_Description_and_Requirements_for_Becoming_a_Data_Management_Analyst.html

“Information on specific programs may be found at Data Management International (DAMA) www.DAMA.org”

37

CDMP Professional Certification

38

Refinement of the Data Management Body of Knowledge

Data Management Functions DMBOK v. 1

Data Management Functions DMBOK v. 2

Was Data Development

New Function

39

Upcoming Learning & Discussion Opportunities

40

Designing the Smarter Organization

5 T H B I E N N I A L O R G A N I Z A T I O N D E S I G N W O R L D C O N F E R E N C E

LEARN HOW to identify and use your organization’s work levels and talent capability to design and align – strategy – analytics – structure – people - innovation to capture big data’s full potential.

DISCUSS AND SHARE with your peers from around the world – CEOs, CHROs, CIOs, CDOs and the senior consultants who support them.

July 31-August 5, 2014

IBM Palisades Conference CenterNew York City area

Click for detailed conference information.

HRPS and SHRM affiliates receive a 15% discount on the conference price.

Scholarships for non-profit executives and academics.

Email or call the Society at +1-416-463-0423

www.globalro.org

Engage before, during, and after the conference:

Before

identify and articulate strategic design issues.

oncept knowledge through our e-learning modules.

During

practitioners share their latest insights and experiences in smarter design.

After

Thank you!

Mehmet Orun, CDMPDirector, Data Solutions

Salesforce.com

Eva Smith, CDMPDirector of IT and eLearning

Edmonds Community College

Peter Aiken, PhDFounding Director, Data Blueprint

Associate Professor, VCUPast President DAMA International

Now it’s your turn!

41


Upcoming Events

42

April Webinar: Data Quality EngineeringApril 8, 2014 @ 2:00 PM – 3:30 PM ET(11:00 AM-12:30 PM PT)

May Webinar: Data Architecture Requirements May 13, 2014 @ 2:00 PM – 3:30 PM ET(11:00 AM-12:30 PM PT)

Sign up here:• www.datablueprint.com/webinar-schedule • www.Dataversity.net

Brought to you by:

Tell your story…• What is your job title?• What is your highest level of education?• What was your degree major(s)• How long have you been working in Data Management?• What are the top five skills you need to perform your job?• What are the top five knowledge areas needed to perform

your job?• What are the top five personal traits that contribute to

success in the data management profession? • Please share your personal story about how you came into

the data management profession so that others can learn from your experiences.

43

Appendix

44


Thank to input and consultation from ...

• Ken Sheppard, PhDPresident, Global Organization Design [email protected] - http://globalro.org

45


Designing the Smarter Organization

5 T H B I E N N I A L O R G A N I Z A T I O N D E S I G N W O R L D C O N F E R E N C E

LEARN HOW to identify and use your organization’s work levels and talent capability to design and align – strategy – analytics – structure – people - innovation to capture big data’s full potential.

DISCUSS AND SHARE with your peers from around the world – CEOs, CHROs, CIOs, CDOs and the senior consultants who support them.

July 31-August 5, 2014

IBM Palisades Conference CenterNew York City area

Click for detailed conference information.

HRPS and SHRM affiliates receive a 15% discount on the conference price.

Scholarships for non-profit executives and academics.

Email or call the Society at +1-416-463-0423

www.globalro.org

Engage before, during, and after the conference:

Before

identify and articulate strategic design issues.

oncept knowledge through our e-learning modules.

During

practitioners share their latest insights and experiences in smarter design.

After

46

Scope of the Profession

Data Analyst

Data Architect

Data Modeler

Data Governance Analyst/Manager

Database Administrator

IT Security Administrator

Integration Analyst

ETL ProgrammerDocument &Content MetadataSpecialists

MDM Specialist

Master Data Architect

DW Specialist

BI Analyst

Metadata Architect

Metadata Librarian

Data Quality Analyst

Enterprise Architect

Jobs / Specializations

47


Level 2 - Data Manager

48

RO Level



in charge of ...

Planning Horizon

1 Front Line/ Operator n/a Prescribed

Function < 3 months

2 (often first) Line Manager Data Manager Operational

Function < 1 year

• Not planning horizon– but Time for the longest task in the role

• Able to manage groups of data professionals– Understands both the technical nature of

their work but also how it complements specifics in the business

• Focus:– Identifies and delivers the current and

(immediate) future tactical data needs of this organization

– Back office– Risk concept: avoidance

• Note: The vast majority of data professionals also have– Little formal training;– A largely technical focus– An emergent body of knowledge; – No recognition of the role of their craft by

IT peers– No governance role– Source of future CDOs


Level 3 - Data Director

49

RO Level



in charge of ...

Planning Horizon


Function < 3 months


Function < 1 year

3Director/

Department Manager

Data Director/Data Steward


Optimization

< 2 years

• Focus: How can data be better leveraged?– Efficient support for data costs (i.e.,

regulatory compliance) – Business/data reengineering

improvements – Annual focus cycle – Risk concepts: data quality, accuracy,

recovery, failure to meet regulatory/ compliance deadlines/requirements

• (Departmental) Data Director– Simultaneously is the unit's data

steward – Unit level expertise – Application or application family context

(e.g.; Oracle Applications) – Owns processes, supporting

technologies, and personnel required to advantageously share the area's data

– Possess many of the requisite CDO KSAs, but lacks CDO authority and cannot influence IT


Level 4 - Deputy CDOs

50

RO Level



in charge of ...

Planning Horizon


Function < 3 months


Function < 1 year

3Director/

Department Manager





Deputy CDO/Director Unit Data

Governance


• Deputy Chief Data Officer– A CDO must demonstrate one year

success prior to Deputy CDO implementation

– CDO potential – Improves data leveraging across the

organizational unit – Coordinates with technology, process, and

other architecture levels – Has "inherited authority" to negotiate with

IT regarding project commencement

• Focus: – Sub-organizational (e.g.; a Marketing

CDO) integrative thinking – Implements advantageous data leveraging

throughout the organizational unit – Developing/implementing a breakthrough

unit data strategy – Innovative unit-based data products/

services/customers/markets – Risk concepts: security risks &

information losses


Level 5 - Chief Data Officer

51

RO Level


Data Professionals

Title

in charge of ...

Planning Horizon

1 Front Line/ Operator n/a Prescribed Function < 3 months


Function < 1 year

3Director/

Department Manager






Governance


5 President/ Managing Director

CDO/Director Unit Data Governance

Business Unit

5 - 10 years

• Chief Data Officer– Across business units within a holding

company– Simultaneously is the unit's

Director of Data Governance – Has 'gateway' authority over IT project

commencement – Improving data leveraging within the

organizational unit but implemented using multiple business models

– Reporting results in terms of long- term, unit valuation

• Focus: – Transformational business model

innovation through data products and services

– Multi-generational technology stacks – Implements advantageous data

leveraging across the organizational unit – Risk concepts: reputation, vulnerability,

valuation


Level 6 - Global CDO

52

RO Level


Data Professionals

Title

in charge of ...

Planning Horizon


Function < 3 months


Function < 1 year

3Director/

Department Manager






Governance



CDO/Director Unit Data Governance Business Unit 5 - 10

years

6 EVPGlobal CDO/Dir.


Multi-Business

Organization10 - 20 years

• Global CDO– Building data frameworks across

cultures, national legal frameworks, for the enterprises ecology of suppliers and customers as well as internally.. like Google's and Amazon's platforms that serve ecologies

– Simultaneously is Director, Organizational Data Governance

– A CDO must demonstrate one year success prior to the existence of a Global CDO

• Focus: – Improving data leveraging

across organizational units– Risk concepts: reputation,

vulnerability, valuation


Requisite (Natural Order) Organization Principles

53

RO Level


Data Professionals Title in charge of ... Planning

Horizon7 CEO n/a Global Organization 20+ years

6 EVPGlobal CDO/Dir.


Multi-Business Organization 10 - 20 years


CDO/Director Unit Data Governance Business Unit 5 - 10 years

4VP/General

ManagerDeputy CDO/Director Unit Data Governance Organizational Unit 2 - 5 years

3Director/

Department Manager




2(often first)

Line Manager Data Manager Operational Function < 1 year

1 Front Line/ Operator n/a Prescribed Function < 3 months

CD

O O

pera

ting

Ran

ge