JO TNI

S TA FFCH IE FS OF

JO TNI

S TA FFCH IE FS OF

1

UNCLASSIFIED

UNCLASSIFIED

Integration of Statistics and Metrics into the

Lessons Learned Program

Operational Plans and Joint Force Development Directorate (J-7), The Joint Staff

Mr. Shelby BallJS J7 Joint Lessons Learned Branch

JO TNI

S TA FFCH IE FS OF

JO TNI

S TA FFCH IE FS OF

2

UNCLASSIFIED

UNCLASSIFIED

Agenda

• Purpose

• Definitions

– Statistics

– Metrics

• Current Statistics

• Future Statistics and Metrics

– DOTMLPF tracking

– Impact

• Lives and dollars saved

• Best practices

JO TNI

S TA FFCH IE FS OF

JO TNI

S TA FFCH IE FS OF

3

UNCLASSIFIED

UNCLASSIFIED

Purpose

• To set the stage to begin to collect the statistics and metrics needed to provide meaningful data for program management and functional/operational effectiveness of the lessons learned program.

JO TNI

S TA FFCH IE FS OF

JO TNI

S TA FFCH IE FS OF

4

UNCLASSIFIED

UNCLASSIFIED

Definitions

• Statistics

1: a branch of mathematics dealing with the collection, analysis, interpretation, and presentation of masses of numerical data2: a collection of quantitative data

• Metrics

1: a system of related measures that facilitates the quantification of some particular characteristic

2: a basis for comparison; a reference point against which other things can be evaluated; "the schools comply with federal standards"; "they set the measure for all subsequent work"

JO TNI

S TA FFCH IE FS OF

JO TNI

S TA FFCH IE FS OF

5

UNCLASSIFIED

UNCLASSIFIED

Current Statistics

JO TNI

S TA FFCH IE FS OF

JO TNI

S TA FFCH IE FS OF

6

UNCLASSIFIED

UNCLASSIFIED

Current Statistics

UNCLASSIFIED 7

CE2T2 Assessment Q2 FY2009

DRAFT – as of 17 July 2009

• Metric/Statistics– JLLIS usage as indicated by the following data (PBR 11007):

• Since 1 Oct 07, 27 organizations have signed up to use JLLIS

• Number of JLLIS Users

• Number of Active Lessons

• Number of Hits on JLLIS

• Findings– Trend analysis requires dedicated analysts; currently no automated tool.– MCCLL is key to the outstanding progress JLLIS has made over the past 18 months.

• Future Developments– By Oct 11, JLLIS should have all COCOMs using and sharing data and all legacy data imported into the system.– As JLLIS matures, the current statistics may be expanded to provide better metrics on the integration of JLLIS data

into DOTMLPF programs.

12. Implementation of Joint Lessons Learned Information System (JLLIS)

Joint training

accomplished

prior to combat

deployment

Irregular

warfare training

Whole of

government

and

international

training

Impact of joint

training

Impact of joint

training

enablers

Implementation

of joint training

Joint Staff 1 CSAs 4COCOMs 10 Interagency 33 Services+NGB 4 Other Organizations 5

  Sep 07 Sep 08 CY09 Q1 CY09 Q2NIPR 9,584 23,456 28,550 32,505SIPR 5,607 10,475 15,623 16,870

  Sep 07 Sep 08 CY09 Q1 CY09 Q2NIPR 7,244 25,800 29,855 30,814SIPR 16,671 89,462 99,328 105,161

  Dec 07 Sep 08 CY09 Q1 CY09 Q2NIPR 163,392 754,888 2,987,516 2,407,612SIPR 133,664 745,424 4,670,074 5,264,860

UNCLASSIFIED 8

CE2T2 Assessment Q2 FY2009

DRAFT – as of 17 July 2009

0

20,000

40,000

60,000

80,000

100,000

120,000

Sep 2007 Sep 2008 Feb 2009

0

500,000

1,000,000

1,500,000

2,000,000

2,500,000

3,000,000

3,500,000

4,000,000

4,500,000

5,000,000

NIPR Active Lessons

SIPR Active Lessons

NIPR Hits

SIPR Hits

Joint Lessons Learned Information System StatisticsLe

sson

s

Hits

Source: Joint Staff J7 JLLIS Program Office

JO TNI

S TA FFCH IE FS OF

JO TNI

S TA FFCH IE FS OF

9

UNCLASSIFIED

UNCLASSIFIED

Future Statistics and Metrics

• DOTMLPF tracking

– Must explore methods of tracking observations, issues, and lessons from cradle to grave

– Must develop capability to identify when data is incorporated in DOTMLPF at all levels i.e., tactical, operational, and strategic

– Must coordinate process/method with all JLLP organizations and JFCOM and JS J8 for integration into the JROC process

JO TNI

S TA FFCH IE FS OF

JO TNI

S TA FFCH IE FS OF

10

UNCLASSIFIED

UNCLASSIFIED

Future Statistics and Metrics

• Impact characteristics

– Lives and dollars saved

– Best practices

– Identification of gaps and shortfalls

– Improvements in operations, tactics, techniques and procedures; resolutions of issues, and identifications of lessons learned and not repeated

– Etc.

JO TNI

S TA FFCH IE FS OF

JO TNI

S TA FFCH IE FS OF

11

UNCLASSIFIED

UNCLASSIFIED

Action

• Need each organization to submit ideas on how to capture meaningful statistics and metrics within JLLIS

• Submit ideas as CRB requirements for consideration and incorporation into JLLIS

JO TNI

S TA FFCH IE FS OF

JO TNI

S TA FFCH IE FS OF

12

UNCLASSIFIED

UNCLASSIFIED

QUESTIONS?