1 prelim findings version 2 final findings presentation 2011-11-11 sm scampi is a service mark of...

1Prelim Findings version 2

Final Findings Presentation

2011-11-11

SM SCAMPI is a service mark of Carnegie Mellon University

Standard CMMI Appraisal Method for Process Improvement (SCAMPI v1.2)

SCAMPISM Lead Appraiser IDNeil Potter (0300286-01)


Agenda

• Objectives of Appraisal• Overview of Appraisal• Appraisal Activities• Capability Maturity Model Integration®

• Scope of Appraisal• Findings• Ratings• Comments & questions


Objectives of Appraisal

• Understand the organization's current management and engineering practices

• Provide an accurate picture relative to CMMI:– Collect process data to understand the current

implemented process– Identify process strengths and weaknesses– Determine the degree of satisfaction of the Process

Areas investigated– Assign ratings / characterizations


Overview of Appraisal

• Organization Undergoing Appraisal

• Sponsor of the Appraisal


Overview of Appraisal

• Appraisal Team Members– Neil Potter, team lead, The Process Group


1.Optional:

Conduct Opening Meeting

9.Deliver Appraisal

Results/ Present Final

Findings

10. Conduct Executive

Session

6.Prepare Prelim

Findings + Validate OE

8. Consolidate, Rate and Generate

Appraisal Results

11.Assessment Wrap-up

Day 1 Day 5

Parallel Activities:Perform Document Review

Perform Follow-up Interviews

2.Interview Project

Leaders +Verify OE

3.Interview

Snr./Middle Managers +Verify OE

Appraisal Activities

5.Consolidate +Examine OE

4.Interview

Functional Area Representatives +

Verify OE

7.Present Prelim

Findings + Validate OE



OE = Objective Evidence


CMMI 1.2 - Staged Representation

Organizational Innovation and Deployment (OID)Causal Analysis and Resolution (CAR)

5 Optimizing

4 Quantitatively Managed

3 Defined

2 Managed

ContinuousProcess Improvement

QuantitativeManagement

ProcessStandardization

BasicProjectManagement

Organizational Process Performance (OPP)Quantitative Project Management (QPM)

Requirements Development (RD)Technical Solution (TS)Product Integration (PI)Verification (VER)Validation (VAL)Organizational Process Focus (OPF)Organizational Process Definition +IPPD (OPD)Organizational Training (OT)Integrated Project Management +IPPD (IPM)Risk Management (RSKM)Decision Analysis and Resolution (DAR)

Requirements Management (REQM)Project Planning (PP)Project Monitoring and Control (PMC)Supplier Agreement Management (SAM)Measurement and Analysis (MA)Process and Product Quality Assurance (PPQA)Configuration Management (CM) Risk

Rework1 Initial

Process AreasLevel Focus QualityProductivity


Scope of Appraisal (Organization)

• Participated in discussions during appraisal– n project leaders– n management representatives– n software practitioners– n validation– n EPG– n QA– n CM– n HR


Scope of Appraisal (Model)

• Maturity Levels Investigated:– Level 3 investigated

• Process Areas Not Applicable:– SAM

Prelim Findings version 2 10

Findings Summary

Maturity Level 2 Process Areas


Requirements Management

Description:– The purpose of Requirements Management (REQM) is to manage the

requirements of the project's products and product components and to identify inconsistencies between those requirements and the project's plans and work products.

Strengths:– 公司用 CCB 制度管理需求，并使用需求跟踪矩阵跟踪需求变更的影响与范围。– Requirements are managed using the CCB. RTM tracks the relationship and

impact of requirements changes.


Requirements Management

Improvement Opportunities: 无


Project Planning

Description:– The purpose of Project Planning (PP) is to establish and maintain plans that

define project activities.

Strengths:– 公司有制定详细的项目计划，内容包括规模（功能点）、工作量、风险、进度

和干系人。– Project plans are developed, including size (), effort, risks, schedule and stake

holders.


Project Planning



Project Monitoring and Control

Description:– The purpose of Project Monitoring and Control (PMC) is to provide an

understanding of the project’s progress so that appropriate corrective actions can be taken when the project’s performance deviates significantly from the plan.

Strengths:– 公司对工作量、成本和进度进行了跟踪。并在偏差达到一定的阀值时（ 10% ）

进行计划调整。– Actual effort, cost and schedule tasks are tracked. Replans occur at defined de

viation percentages (e.g., 10%)


Project Monitoring and Control

Improvement Opportunities: – 加班工作量要认真收集，以供项目经理、项目组成员和高管了解加班的状况，

掌握项目员工实际生产率，减少项目风险，意识到加班所带来的潜在风险。– 建议加班时间可以累计、可以进行调休。

– Team members need to be more involved in looking at actual effort expended to help management understand the risk of relying on overtime, and improve estimates for future work


Measurement and Analysis

Description:– The purpose of Measurement and Analysis (MA) is to develop and sustain a

measurement capability that is used to support management information needs.

Strengths:– 公司定义了测量目标并对其进行跟踪（节约成本、合理利用项目资源、控制进

度、提高生产率）。并把数据记录在测量报告和阶段报告。– Measurement objectives are defined and tracked ().


Measurement and Analysis



Process and Product Quality Assurance

Description:– The purpose of Process and Product Quality Assurance (PPQA) is to provide

staff and management with objective insight into processes and associated work products.

Strengths:– QA 使用已定义的检查单在各阶段进行过程检查。 – QA performs process checks for each phase using defined checklists.


Process and Product Quality Assurance



Configuration Management

Description:– The purpose of Configuration Management (CM) is to establish and maintain

the integrity of work products using configuration identification, configuration control, configuration status accounting, and configuration audits.

Strengths:– CM 公司对配置管理进行了策划，并使用 SVN 作为管理工具。– Artifacts to be managed are defined in a CM plan, and managed using SVN.


Configuration Management



Maturity Level 3 Process Areas


Requirements Development

Description:– The purpose of Requirements Development (RD) is to produce and analyze

customer, product, and product-component requirements.

Strengths:– 公司与客户访谈获取需求，并对需求进行优先级排序和评审。– Requirements are elicited from the customer, prioritized and reviewed.


Requirements Development



Technical Solution

Description:– The purpose of Technical Solution (TS) is to design, develop, and implement

solutions to requirements. Solutions, designs, and implementations encompass products, product components, and product-related lifecycle processes either singly or in combinations as appropriate.

Strengths:– 项目组编写了概要设计与详细设计，并在设计文档中对接口进行了定义。项目组还

对编码和设计进行了评审。– High-level, low-level designs are created. Interfaces are defined in design

documents. Code and design are reviewed for defects.


Technical Solution



Product Integration

Description:– The purpose of Product Integration (PI) is to assemble the product from the

product components, ensure that the product, as integrated, functions properly, and deliver the product.

Strengths:– 建立专门的集成环境、配备专职集成人员进行系统集成。也有对集成进行策

划。


Product Integration

Improvement Opportunities: – 建议对接口的变更有更加全面的跟踪（例如 : 把接口放到需求跟踪矩阵里进行跟

踪）


Verification

Description:– The purpose of Verification (VER) is to ensure that selected work products

meet their specified requirements.

Strengths:– 项目组按照 WBS 中的安排进行了同行评审和单元测试。– Peer reviews and component testing are performed and planned in the WBS.


Verification

Improvement Opportunities: – 同行评审的效率不高。加强代码走查，走查时，不但关注规范性，还要注重具

体实现。– 项目组成员必须定期查看同行评审和验证的数据。– 建议对代码走查的数据进行分析，加强同行评审的效果。– 项目组成员应该更加熟悉公司对此过程域的期望。

– Need to find more interface issues before system test. For example, review interface definitions in RTM, peer review interface definitions in requirements, design and code reviews, and test interfaces during component test.


Validation

Description:– The purpose of Validation (VAL) is to demonstrate that a product or product

component fulfills its intended use when placed in its intended environment.

Strengths:– 制定并根据测试计划进行相关的测试。并且搭建了专门的测试环境。


Validation



Organizational Process Focus

Description:– The purpose of Organizational Process Focus (OPF) is to plan, implement,

and deploy organizational process improvements based on a thorough understanding of the current strengths and weaknesses of the organization’s processes and process assets.

Strengths:– 公司按照商业目标进行过程改进（提高软件和项目的质量，降低缺陷率，降低

产品和项目的开发成本）。– Business objectives are used to drive process improvement ().


Organizational Process Focus



Organizational Process Definition

Description:– The purpose of Organizational Process Definition (OPD) is to establish and

maintain a usable set of organizational process assets and work environment standards.

Strengths:– 公司定义了完整的标准过程，并在 PDP 中体现，包括了瀑布、迭代、增量等模

型的裁剪指南。– There is a defined set of processes to use, summarized in the PDP.

Includes waterfall, Spiral and some tailoring guidelines.


Organizational Process Definition

Improvement Opportunities: – 建议大家使用更多的生命周期模型或者修改文档，把模型删减。按照实际要求来选择。

– It is suggested to use and experience other lifecycles in addition to waterfall.


Organizational Training

Description:– The purpose of Organizational Training (OT) is to develop the skills and

knowledge of people so they can perform their roles effectively and efficiently.

Strengths:– 公司融合了员工技能与部门需求，进行了培训的策划。– Training is planned for the department based on staff skill needs and business

objectives.


Organizational Training

Improvement Opportunities: – 增加培训时间，来支持公司的发展。


Integrated Project Management

Description: – The purpose of Integrated Project Management (IPM) is to establish and

manage the project and the involvement of the relevant stakeholders according to an integrated and defined process that is tailored from the organization's set of standard processes.

Strengths:– 项目组使用了财富库的数据、历史数据和裁剪进行项目策划。– Projects use the PAL assets and historical data to plan their projects, with

some use of tailoring .


Integrated Project Management

Improvement Opportunities: – When projects get bigger and there are more external dependencies and

groups to coordinate, expand the use of IPM to include having a master schedule to track and manage these dependencies. » An integrated plan is not just a merge of sub plan documents


Risk Management

Description:– The purpose of Risk Management (RSKM) is to identify potential problems

before they occur, so that risk-handling activities may be planned and invoked as needed across the life of the product or project to mitigate adverse impacts on achieving objectives.

Strengths:– 项目组对风险进行了评估，管理和评审，并在关键里程碑中进行更新。– Risks are assessed, managed and reviewed, and updated at major milestones.


Risk Management



Decision Analysis and Resolution

Description:– The purpose of Decision Analysis and Resolution (DAR) is to analyze possible

decisions using a formal evaluation process that evaluates identified alternatives against established criteria.

Strengths:– 每个项目都对技术方案进行了决策分析。– DAR has been used at least once per project for technical solution or tool selec

tion.


Decision Analysis and Resolution

Improvement Opportunities: – 体系文件应进一步细化决策分析的应用准则 , 并考虑在项目中使用更多的决策分

析。– It is suggested to further define the DAR application criteria and consider

performing more DARs.– 评价的方法只使用了讨论法。进行方案评价的时候使用除 Delphi 以外的方法

（模拟法进行方案的调研研究）。


Global Findings


Global Strengths

Strengths: • 技术能力较强• 领导亲和力强• 好的项目管理及汇报机制• 公司工作氛围好• 提供了很多的锻炼机会• 午餐不错


Global Areas to Improve

Improvement Opportunities: • 希望多组织一些团队活动，以便加强沟通。• 加班可以调休。• 更新电脑设备，提高配置。• 改善网络环境。• 提供多元化培训，提供多媒体影像培训，提供更多技术方面？、管理方面的培训，增加平均培训时间。

• 为长期外派的同事提供轮换机制。


Global Areas to Improve

Improvement Opportunities:

• x


Rating of CMMI Goals

• The goal is rated Satisfied if– there are no findings that document the weaknesses

associated with a goal,• OR

– (a) all associated practices are characterized at the organizational unit level as either Largely Implemented or Fully Implemented, and (b) the aggregate of weaknesses associated with the goal does not have a significant negative impact on goal achievement.

• Otherwise the goal is rated Unsatisfied.

© 2003 by Carnegie Mellon University


Rating of Process Areas(Staged)

Satisfied If and only if all of the process area’s relevant specific and generic goals are rated as satisfied.

Unsatisfied One or more relevant goals of the process area are rated unsatisfied.

Not applicable Process area is determined to be outside the organization unit’s scope of work during planning by

the Team Leader and Sponsor.

Not rated One or more of the goals in a PA is rated Not Rated and none of the other goals are rated Unsatisfied.

Out of Scope Process area is outside reference model scope.


Process Area Profile (Staged)

Congratulations on achieving: xxx


Goal Rating Profile - Level 2


Goal Rating Profile - Level 3


Comments & Questions?

Team Signature PageI support the findings in this presentation and affirm that to the best of my knowledge it represents an accurate portrayal of the state of the process in the appraised organization.

Team Role Name (printed/typed) Signature Date

ATL Neil Potter

ATM

ATM

ATM

ATM

1 prelim findings version 2 final findings presentation 2011-11-11 sm scampi is a service mark of...

Documents

appraisal slide

prelim findings version

present prelim findings

oe appraisal activities

appraisal sponsor

process group slide

process strengths

process data