I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Pacific Air Forces

As of: 1

PACAF GeoBase CapabilityMaturity Model: Metrics for

Program SustainmentMSgt Lance FillerMr. Ben McMillan

HQ PACAF GIO

As of: 2I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Overview

BackgroundCapability Maturity ModelingTailoring the CMMi for PACAF GeoBaseCMMi in PracticeRoad Ahead

As of: 3I n t e g r i t y - S e r v i c e - E x c e l l e n c e

USAF GeoBase Program

USAF GeoBase FoundationsUSAF GeoBase Foundations

Strategic GeoBaseGarrison GeoBase

Syst

ems

Arch

itec

ture

Syst

ems

Arch

itec

ture

Syst

ems

Arch

itec

ture

Syst

ems

Arch

itec

ture

Fina

ncia

l Man

agem

ent

Fina

ncia

l Man

agem

ent

Polic

y, &

Gui

danc

ePo

licy

& G

uida

nce

Educ

atio

n &

Tra

inin

gEd

ucat

ion

& T

rain

ing

Peop

le &

Wor

kflo

wPe

ople

& W

orkf

low

Info

rmat

ion

Arc

hite

ctur

eIn

form

atio

n A

rchi

tect

ure

Info

rmat

ion

Arc

hite

ctur

eIn

form

atio

n A

rchi

tect

ureExpeditionary Site Mapping (GeoReach)

As of: 4I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Metrics through the years…

5

AndersenAndersenElmendorfElmendorfEielsonEielsonHickamHickamKadenaKadenaKunsanKunsanMisawaMisawaOsan/RHSOsan/RHSYokotaYokota611 ASG611 ASGCOBSCOBS

ImageImage BCOPBCOP DataData GeoBaseGeoBase

Not StartedNot Started StartedStarted CompleteComplete

GeoBase Status FY00GeoBase Status FY00

StratStrat PlanPlan

Web Web Enabled Enabled

AndersenAndersenElmendorfElmendorfEielsonEielsonHickamHickamKadenaKadenaKunsanKunsanMisawaMisawaOsanOsanYokotaYokota611 ASG611 ASG607 ASG607 ASG

CIPCIP RIPRIPCMD CMD CtrCtr

(DCC/SRC)(DCC/SRC)

Not StartedNot Started StartedStarted CompleteComplete

IOCIOC

Garrison GeoBase Status30 Oct 02

As of: 7I n t e g r i t y - S e r v i c e - E x c e l l e n c e

PACAF GeoBase MetricsFY03

CE MDSRIP

99

02

99

02

99

00

00

01

01, 02

Photo

94%

90%

83%

90%

95%

90%

95%

100%

89%

CIP

Yokota

Osan

Misawa

Kunsan

Kadena

Hickam

Elmendorf

Eielson

Andersen

Other MDSInstallation

As of: 8I n t e g r i t y - S e r v i c e - E x c e l l e n c e

A better method wasneeded to evaluate our

program…

As of: 9I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Capability Maturity ModelIntegration (CMMi)

Developed by the Software Engineering Institute atCarnegie Mellon University

A capability maturity model is a reference of maturepractices in a specified discipline, used to assess a group’scapability to perform that disciplineProcess provides a constructive, high-level focus…

As opposed to a focus on peopleYour work force, on the average, is as “good” as it is trained to beWorking harder is not the answerWorking smarter, through process, is the answer

As opposed to a focus on technologyTechnology applied without a suitable roadmap will not result insignificant payoffTechnology provides the most benefit in the context of an appropriateprocess roadmap

Our discipline is GeoBaseOur process areas define our capabilities…

As of: 10I n t e g r i t y - S e r v i c e - E x c e l l e n c e

PACAF GeoBase Processes

PlanningCapability DevelopmentSustain CapabilityConfiguration ManagementCustomer ServiceOrganizational DevelopmentProject Monitoring and ControlMission Integration

As of: 11I n t e g r i t y - S e r v i c e - E x c e l l e n c e

GeoBase Process AreasPlanning

Strategic PlanStrategic Plan is current and accurately reflects the goals, objectives,and strategies planned for the time periodMilestones are clearly articulated, dates and OPRs assignedAnticipated requirements (e.g. sw maintenance) are clearly articulatedAnticipated requirements are reported to Flight Chief wheneverStrategic Plan is revised

Configuration Management PlanCM plan is current and accurately reflects the inventory of technology,data & personnel assets associated with GeoBaseProcesses for data collection, data maintenance, databaseadministration (e.g. backup), service delivery are clearly articulated

Capability DevelopmentData acquisitionData quality controlSystems engineering

As of: 12I n t e g r i t y - S e r v i c e - E x c e l l e n c e

GeoBase Process Areas (cont’d)

Sustain CapabilityProcess and maintain CIP

Required, if applicable, CIP layers are presentLayers have correct spatial referenceCorrect SDSFIE layer & attribute names are usedLayers (features) and required attributes are complete andcurrentAverage spatial accuracy is known and meets ASPRS

Process and maintain Regional Installation Picture(RIP)

Wing/CC has defined spatial extent of RIPADRG 1:50,000 TLM or USGS 1:24,000 DRG are presentIKONOS, QB imagery or other regional imagery, e.g. USGSDOQQ are presentSDSFIE nomenclature and appropriate metadata

As of: 13I n t e g r i t y - S e r v i c e - E x c e l l e n c e

GeoBase Process Areas (cont’d)

Sustain Capability(cont)Process and maintain raster resources

Raster coverage exists that was captured within thepast five years and has one-meter or less resolutionAn image catalog existsAn image mosaic exists

Process and maintain Mission Data Sets (MDS)Layers have correct spatial referenceCorrect SDSFIE layer & attribute names are usedLayers (features) and required attributes arecomplete and currentAverage spatial accuracy is known and meetsASPRS

As of: 14I n t e g r i t y - S e r v i c e - E x c e l l e n c e

GeoBase Process Areas (cont’d)

Configuration ManagementThe practices outlined in the Configuration ManagementPlan are properly executedGeoBase architectures (data and systems) are effectivelymanaged

Customer ServiceHard copy maps available to key personnelMDS available to key mission elementsGeoBase client solutions

Viewers (ArcIMS, ArcReader, ArcGIS)Analysis (GeoBest, CAPP, GeoBase Toolkit)

Geospatial supportOrganizational Development

Personnel know rolesTraining programs exist

As of: 15I n t e g r i t y - S e r v i c e - E x c e l l e n c e

GeoBase Process Areas (cont’d)

Project Monitoring and ControlReview milestones in Strategic PlanExecute reporting requirements

Mission IntegrationSenior leader awarenessSenior leader advocacy

As of: 16I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Capability Score

Points assessed for meeting requirements in each processarea

Percentages calculated for each process areaFor Sustaining Capability, scores are normalized to allow forthe growth of data requirements

Individual percentages for CIP, RIP, Raster, and MDSThese percentages are averaged to provide process area score

As of: 17I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Capability Score (cont’d)

Weights assigned by PACAF GIO used to calculatefinal score

As of: 18I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Maturity Model in Practice

Structured AssessmentsStaff Assistance Visit (SAV)

Focus discussionsEasily pinpoint areas of improvementQuantifiable results to provide senior leadership

Installations required to self-assess each quarterResults provided to HQ PACAF GIOContinuous reference for program growth andimprovement

As of: 19I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Lessons Learned

Pro’sModel can change as program changesNormalized values effectively diagnose change, evenas requirements growEasier for HQ to target improvement areasProvides very graphic status snapshots forcommanders

Con’sSome questions are still subjective and may beinterpreted differently at each baseAnswers subject to attitude, time, effortDistilling diverse program elements into processareas can be problematic

As of: 20I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Road AheadUpdates to Model

Inclusion of MDS defined by FOA’sExpansion of AF data model to include EKBConfiguration requirements for enterprise databasemanagementConfiguration requirements for IMS managementEvaluating customer service

Difficult to gauge, many criteria involvedCIP is available to everyone through IMSNot everyone has MDSDifferent customers served at every baseHow to rate custom service solutions

Incorporate ideas from other sources includingProject Management Institute (Risk Management)

As of: 21I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Questions?

HQ PACAF Geo Integration Officepacaf.geobase@hickam.af.mil

MSgt Lance S. FillerDSN 448-0403

lance.filler@hickam.af.mil

Ben McMillanDSN 449-7452

benjamin.mcmillan@hickam.af.mil

As of: 22I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Backup Slides

As of: 23I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Defining Initial OperatingCapability (IOC) seems simple…

PACAF GeoBase IOC components:Strategic PlanCommon Installation Picture (CIP)Geo Integration Office (GIO)Hardware/Software

As of: 24I n t e g r i t y - S e r v i c e - E x c e l l e n c e

…measuring it is something else

Strategic PlanAligned with HHQ guidance?Endorsed by senior leadership?Actively followed and updated?

CIPLayers present or absent?Format meets PACAF CIP spec?Layers complete (features and attributes)?Metadata complete?How do you define complete?Accuracy assessment?

GIOMilitary participation and oversight?Dedicated or additional duty?

HW/SWOptimal mix of CIP Production & maintenance equipment?Will base fund refresh?

AndersenAndersenElmendorfElmendorfEielsonEielsonHickamHickamKadenaKadenaKunsanKunsanMisawaMisawaOsan/RHSOsan/RHSYokotaYokota611 ASG611 ASGCOBSCOBS

ImageImage BCOPBCOP DataData GeoBaseGeoBase

Not StartedNot Started StartedStarted CompleteComplete

GeoBase Status FY00GeoBase Status FY00

Strat PlanStrat Plan

FundedFunded

As of: 5I n t e g r i t y - S e r v i c e - E x c e l l e n c e

AndersenAndersenElmendorfElmendorfEielsonEielsonHickamHickamKadenaKadenaKunsanKunsanMisawaMisawaOsanOsanYokotaYokota611 ASG611 ASG607 ASG607 ASG

Not StartedNot Started StartedStarted CompleteComplete

CIPCIP ArchitectureArchitecture ManningManning IOC IOC StratStrat PlanPlan

PACAF GeoBase Status1 Jan 01

As of: 6I n t e g r i t y - S e r v i c e - E x c e l l e n c e

IOC IOC

AndersenAndersenElmendorfElmendorfEielsonEielsonHickamHickamKadenaKadenaKunsanKunsanMisawaMisawaOsanOsanYokotaYokota611 ASG611 ASG607 ASG607 ASG

CIPCIP ArchitectureArchitecture ManningManning

Not StartedNot Started StartedStarted CompleteComplete

StratStrat PlanPlan

PACAF GeoBase Status29 May 02

ECDECD

-- -- ---- -- ---- -- ---- -- ---- -- ---- -- ---- -- ---- -- ---- -- --TBDTBD

1 Sep 021 Sep 02

As of: 28I n t e g r i t y - S e r v i c e - E x c e l l e n c e

But are we really measuringcapability?

PACAF GeoBase IOC components:Strategic PlanCIPGIOHW/SW

Even with a recipe to organize them, ingredientsdon’t equal capabilitiesPACAF GeoBase IOC capabilities

Develop and administer CIP/RIPHost MDSGeoBase Service AssuranceTraining & Technology Transfer

Web Web Enabled Enabled

AndersenAndersenElmendorfElmendorfEielsonEielsonHickamHickamKadenaKadenaKunsanKunsanMisawaMisawaOsanOsanYokotaYokota611 ASG611 ASG607 ASG607 ASG

CIPCIP RIPRIPCMD CMD CtrCtr

(DCC/SRC)(DCC/SRC)

Not StartedNot Started StartedStarted CompleteComplete

IOCIOC

Garrison GeoBase Status30 Oct 02

As of: 30I n t e g r i t y - S e r v i c e - E x c e l l e n c e

Relating Process Area Capabilityand Organizational Maturity

Process area capability and organizational maturityare similar conceptsThe difference between them is that process areacapability deals with a set of processes relating to asingle process area or specific practice, whileorganizational maturity pertains to a set of processareas across an organization

6CMMI Tutorial Apr 22, 2003

Why Focus on Process?

• Process provides a constructive, high-leverage focus...–as opposed to a focus on people

»Your work force, on the average, is as “good” as it is trained to be.

»Working harder is not the answer.»Working smarter, through process, is the

answer.–as opposed to a focus on technology

»Technology applied without a suitable roadmap will not result in significant payoff.

»Technology provides the most benefit in the context of an appropriate process roadmap.

14CMMI Tutorial Apr 22, 2003

What is a CMM?

• Capability Maturity Model: A reference model of mature practices in a specified discipline, used to assess a group’s capability to perform that discipline

• CMMs differ by–Discipline (software, systems, acquisition, etc.)–Structure (staged versus continuous)–How Maturity is Defined (process improvement path)–How Capability is Defined (institutionalization)

• “Capability Maturity Model®” and CMM® are used by the Software Engineering Institute (SEI) to denote a particular class of maturity modelsCapability Ma turity Mode l®, CMM®, CMM Integra tion, and CMMI a re se rvice marks and regis te red trademarks of Carnegie Me llon Univers ity

54CMMI Tutorial Apr 22, 2003

Capability Levels

• A capability level is a well-defined evolutionary plateau describing the capability of a process area.

• There are six capability levels.• Each level is a layer in the foundation for

continuous process improvement.• Thus, capability levels are cumulative, i.e., a

higher capability level includes the attributes of the lower levels.

55CMMI Tutorial Apr 22, 2003

The Capability Levels

5 Optimizing

4 Quantitatively Managed

3 Defined

2 Managed

1 Performed

0 Incomplete