business case: transition to performance-based testing articles/webinars... · symantec...
TRANSCRIPT
CEdMA Certification Special Interest Group
Business Case: Transition to Performance-Based Testing Beverly van de Velde, Symantec, October 18, 2013
CEdMA Certification Special Interest Group
• Symantec Certification & ASC Program
– Program Description & Problem Statement
• Objectives & Expected Outcomes
• What? Why? How?
• Competencies Matrix Snapshot
• Two Pilot Approach
• PBT Exam Development Requirements
• PBT Cost Model Defined
• Next Steps
• Appendix Topics
Agenda
CEdMA Certification Special Interest Group
Symantec Certification Program
• Candidate reach: global
– Serves customers, partners, employees
• Content scope: validate technical expertise
– Framework: Specialist Professional or Master
– Sales is out of scope
• Certification exam scope:
– 24 written / multiple-choice exams
– TBD 8 - 10 performance based exams (lab and panel / oral exams)
CEdMA Certification Special Interest Group
“The Authorized Symantec Consultant who achieves a
passing grade on an assessment will have demonstrated a
deep knowledge and understanding of the products,
associated consulting services IP, and strong consulting
services business acumen for delivering complex and
successful solutions to Symantec's customers. The exam
places particular emphasis on practical consulting
experience as opposed to product knowledge.”
• The multiple-choice exam is a mismatch when
seeking to measure the Symantec Consulting
real-world skill and ability
Authorized Symantec Consultant Program Description & Problem Statement
CEdMA Certification Special Interest Group
Objectives & Expected Outcomes Objectives
1. Outline and discuss a proposal to pilot performance-based
testing (PBT)
2. Consider the level of effort, resources, time, and costs
Expected Outcomes
1. Validate that Consultants have the knowledge, skill, and ability
to design, deploy, administer, and demonstrate services
delivery and a proof of concept with authority and confidence
across a specific Symantec solutions peak / portfolio.
2. Agree a pilot PBT approach makes sense for replacing an
existing ASC exam
3. List of key agreed actions to be undertaken in the short- term
CEdMA Certification Special Interest Group
What do we want to accomplish? Solve for the Business Outcome & Execute Proposed Pilot
CEdMA Certification Special Interest Group 7
CEdMA Certification Special Interest Group
Two Pilot Approach Education Services will partner with Business Unit teams to pilot
development and implementation of two types of PBTs:
CEdMA Certification Special Interest Group
PBT Exam Development Requirements
CEdMA Certification Special Interest Group 10
CEdMA Certification Special Interest Group
• Confirm who will fund this type of pilot / exam(s); Cost are estimated and to
be determined upon defining the testing scope and development
• Determine target audience and scope of competency testing for the hands on
lab-based exam.
– Do we cover all Consulting competencies or is the scope too broad?
– Pilot with an External Partner only? Symantec Consultants?
– How many consulting partners exist within the External Partner that would
participate in this type of pilot? Would they expect a fee for their time?
• List of SMEs responsible for committing to the design, development, and
execution processes.
• Schedule kickoff meeting with SMEs and key executive sponsor(s)
• For the lab exam, should we use a hosted virtual environment or classroom
training environment? Who will set it up and support it?
• Make programmatic decisions (program name, fit into other larger initiatives,
fit into competency framework, exam & scheduling details, etc.)
• Communications – Who/how to communicate to the pilot candidates?
Next Steps
CEdMA Certification Special Interest Group
• What is performance-based testing?
• Benefits of performance-based testing
• When to conduct panel / oral exams
• When to conduct lab exams
• PBT assumptions
• PBT challenges according to other IT
companies
Appendix Topics Other Content to Have on Hand
