![Page 1: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/1.jpg)
Landscape Architect
Examination Development
Update
Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager
Heidi Lincer, Ph.D., OPES Chief
![Page 2: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/2.jpg)
Professional consulting services in examination validation and development to DCA’s boards, bureaus, and committees
Recommendations based on regulations, professional guidelines, and technical standards related to licensure examinations
The Office of Professional Examinations Services provides
![Page 3: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/3.jpg)
Business and Professions Code Section 139
Principles for the Validation and Use of Personnel Selection Procedures (Society for Industrial and Organizational Psychology)
Standards for Educational and Psychological Testing (American Educational Research Association, American Psychological Association, National Council on Measurement in Education)
Regulations, Standards,
and Guidelines
![Page 4: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/4.jpg)
Licensure Examinations ⚫Must provide a reliable
method for identifying practitioners who are able to practice safely and competently
⚫Focus on entry-level tasks and knowledge important for public protection
⚫Uses input from Subject Matter Experts
![Page 5: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/5.jpg)
Is a candidate who passes the LARE ready to perform landscape architecture
safely and competently in California?
![Page 6: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/6.jpg)
Is the job of Landscape Architect in California different from other states?
• Public parks • No irrigation system • Late July 2019
![Page 7: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/7.jpg)
PASSING OCCUPATIONAL SCORE ANALYSIS
EXAM CONSTRUCTION
oo ITEM REVIEW
EXAM OUTLINE
■ ·····-
Cycle of Examination Development
![Page 8: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/8.jpg)
Client recruits sufficient
number of representative
SMEs
OPES facilitates process and
ensures psychometric standards are
met
![Page 9: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/9.jpg)
Provides a description of current practice Purpose of Occupational Analysis (OA)
Provides the basis of job-related, fair, and legally defensible examinations
Establishes validity by linking examination content to critical job competencies
Provides basis for legislation and policies
![Page 10: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/10.jpg)
Conduct SME telephone interviews and research on the profession
Develop Task and Knowledge statements with SMEs
Develop, administer, and analyze OA survey results
Review survey results with SMEs
Develop examination outline with SMEs
OA Process
![Page 11: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/11.jpg)
Occupational Analysis and CSE content
LARE
CSE
Full practice
+
![Page 12: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/12.jpg)
Psychometric Evaluation
SMEs compare
national OA to California
OA
Identification of any critical entry level content that is not
assessed
Review of National Examinations
![Page 13: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/13.jpg)
Evaluate occupational analysis
Review procedures for developing examination
Review procedures for establishing passing scores
Review examination scoring and passing rates
Review administration and security procedures
Review information available to candidates
![Page 14: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/14.jpg)
National examinations test core, mainstream
practice.
California examinations test what is unique about practice in the state.
• Geology
• Weather
• California health and safety laws
• California-specific practice areas
SMEs compare National OA to California OA What do Landscape Architects do in California that is unique to our state?
FULL PRACTICE
![Page 15: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/15.jpg)
recommendation: • National examination
• California law examination
OPES recommendation: • National examination • California-specific law
and practice examination
OPES recommendation: • California examination
OPES recommendations are based on the results of the OA and National Review
![Page 16: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/16.jpg)
✓Tasks ✓Knowledge
An example of how an Occupational Analysis could change the content of the CSE
Interviews
“What knowledge are needed to perform the tasks?”
Survey Responses
OPES analyzes results
SMEs identify tasks and knowledge about water conservation that are critical for entry level.
Water conservation
LARE Review Outline
SMEs:
“The LARE does NOT test candidates on water conservation.”
New Examination Outline will add water conservation tasks and knowledge.
![Page 17: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/17.jpg)
0
Timeline for the Landscape Architect Examination
Examination development including Item Writing, Item Review, Form Construction, and Passing Score Workshops.
![Page 18: Landscape Architect Examination Development …...2019/11/08 · Landscape Architect Examination Development Update Sacramento, November 8, 2019 Tavi G. Popp, M.A., Research Manager](https://reader034.vdocument.in/reader034/viewer/2022042804/5f5b8160aeff3460765ab054/html5/thumbnails/18.jpg)
Thank you
Any questions?