september 2010 user needs identification for content model development oidap quarterly meeting...

September 2010

USER NEEDS IDENTIFICATION FOR USER NEEDS IDENTIFICATION FOR

CONTENT MODEL DEVELOPMENTCONTENT MODEL DEVELOPMENT

OIDAP Quarterly MeetingOIDAP Quarterly Meeting

Boston, MABoston, MA

Shirleen Roth Social Security Administration

Office of Program Development and Research

Presentation OverviewResearch Purpose and QuestionResearch ActivitiesMethodology for Identification of User Needs

for Content Model DevelopmentCompilation of sourcesSelection criteria for data elements,

dimensions, and data elements for research purposes

Methods for defining selectionsMethods for resolving differences in selections

September 2010 Social Security Administration 2

Presentation Overview (continued)

Methodology (continued)Process for documenting the selectionsAnalysis conducted by Project StaffExamples

Next Steps


Research Purpose and Question

Research Purpose: The purpose of the occupational information system (OIS) project is to create an OIS tailored specifically for SSA’s disability programs and adjudicative needs.

Research Question: What occupational information does SSA need or desire in order to effectively adjudicate claims for disability benefits?What person-side data elements are critical to

assessing an individual’s residual functional capacity?What work-side dimensions are critical to assessing

an individual’s vocational profile?


Research ActivitiesOccupational Information Development Advisory

Panel (Panel) ActivitiesPublic testimony and comments at quarterly

meetingsPanel investigationsContent Model and Classification Recommendations

for the Social Security Administration Occupational Information System (September 2009)

Findings Report: A Review of the National Academy of Sciences Report A Database for a Changing Economy: Review of the Occupational Information Network (O*NET) (June 2010)


Research Activities (continued)Occupational Information System Development

Workgroup (Workgroup) ActivitiesInternal SSA Workgroup comprised of

representatives from stakeholder components within the agency Office of Disability Adjudication and Review (ODAR), Office of

Appellate Operations (Appeals Council) ODAR, Office of Chief Administrative Law Judge Office of Disability Determinations Office of Disability Programs Office of Program Development and Research Office of Quality Performance National Council of Disability Determination Directors

(NCDDD)


Research Activities (continued)Workgroup Activities (continued)

Guidance and support to ensure that the OIS meets user needs and the requirements of SSA’s regulations

Assistance to Project Staff for OIS developmentOutreach to stakeholder components to obtain

input for development of OIS, including identification of user and other programmatic needs

Development of a list of data elements for the OIS that the Workgroup recommends for testing


Research Activities (continued)Project Staff Activities

Support of Panel and Workgroup activitiesSSA User Needs Analysis (UNA)Federal register notices requesting public

comment on the Panel’s September 2009 report. Public comment period closed on June 30, 2010.

Project staff investigationsParticipation in and support of Workgroup

discussions toward development of a list of data elements for the OIS that the Workgroup recommends for testing


Research Activities (continued)Project Staff Activities (continued)

Occupational-Medical Vocational Study of claimsSynthesis of input received from Panel, SSA

UNA, and public testimony/comments through June 30, 2010 Compiled list of all recommendations and comments Organized the list according to the Panel’s seven main

recommendations Added category of “Other” to capture those comments

not related to the seven recommendations


Research Activities (continued)Project Staff Activities (continued)

Synthesis (continued) Established criteria for compiling list of

ideas/comments Combined identical ideas/comments into one item

that noted all groups in support of that item/comment

Did not combine those ideas/comments that were different, even if difference was only slight

For results of survey received from one stakeholder organization, included those data elements that were recommended by 50% or more of respondents


Sample Synthesis Page


Comment Commenter Cross-

Reference Staff Action

Fingering OIDAP; NADE; IARP; APTA

Need information on what’s being picked up. For example, a coin or button

UNA; NCDDD

Finger dexterity required UNA Other term used: fine manipulation, fingering, picking, pinching

UNA

Does the job require them to type UNA Finger dexterity (ability to move the fingers and manipulate small objects with the fingers rapidly or accurately)

APTA

Measure by attitude/skill APTA Make a distinction between fingering and fine fingering ABVE

Gripping (simple, forceful) OIDAP; NADE; APTA; APTA

For gripping /grasping, how much force or strength is required

UNA

Other term used grabbing, grasping UNA

Define as grasping an unsupported object(s) weighing 10 or more lbs per hand, or gripping with a force of 10 or more lbs per hand

APTA

Measure by frequency APTA

Compilation of SourcesSources Used for Identification of User Needs

for Content Model Development Built upon all OIS research activities that have

taken place to dateIn addition to input received from Panel,

Workgroup, SSA UNA, and public, considered: Social Security Act and Regulations Social Security policy guidance including Social

Security Rulings, operating manuals, and training materials

Current SSA forms used to document the assessment of an individual’s residual functional capacity (RFC) (SSA-4734 and SSA-4734-SUP)


Compilation of Sources (continued)

Resources Used for Identification of User Needs for Content Model DevelopmentAlso considered other materials such as

Department of Labor’s Revised Handbook for Analyzing Jobs

Information about Essential Skills compiled by Human Resources and Skills Development Canada

International Classification of Functioning American Medical Association guides to physicians


Selection CriteriaSelection Criteria for Identification of User

Needs for Content Model DevelopmentIncluded all concepts recommended by Panel

or WorkgroupConsidered all concepts suggested by the SSA

UNA or through public testimony/commentsIncluded underlying concepts for DOT data

elements that SSA needs to adjudicate claimsIncluded concepts required by SSA regulationsIncluded concepts contained in the RFC formsIncluded concepts that reflect SSA’s needs


DefinitionsDefinitions for Identification of User Needs for

Content Model DevelopmentEstablished sequential process

1. Definitions required according to SSA regulations. If not available, then

2. DOT definitions. If not available or if the definition has caused difficulty in adjudicating claims, then

3. Panel definitions. If not available or if the definition may need clarification for disability adjudicators, then

4. Definitions identified through other research (e.g., supplied by public commenters, identified in references, found through internet searches, etc.)


Resolving DifferencesThe concept is primaryMethods for resolving differences in selections

If the same concept was represented by both a general term and detailed terms, then the general term was identified as the data element or dimension while the detailed terms were provided as additional occupational information desired by users.

If the same concept was represented by different names, then a sequential process for naming the concept was followed.


Documenting SelectionsDocumentation of selections for the Identification

of User Needs for Content Model Development includesIntroduction, including methodologyChart

Person-side data elements with definitions and related inquiry (first column)

Placeholders for corresponding work-side dimensions with definitions and related work activities (second column). Note, a few work-side dimensions required for vocational analysis were also identified in the second column.

Additional details about the related occupational information desired by users (third column)


Documenting Selections (continued)

Documentation of selections (continued)Endnotes

Source of data element or dimension Rationale for including data element or dimension Explanation of resolution of differences in the data

element or dimension from various sources


Analysis Conducted by Project Staff

Analysis conducted by Project Staff for the Identification of User Needs for Content Model Development Started with a data element or dimension

recommended by the PanelIdentified related data element or dimension

recommended by the WorkgroupIdentified related information from other sources

(e.g., public testimony/comments, SSA UNA, etc.)Reviewed SSA regulations and agency guidance

related to the data element or dimension


Analysis Conducted by Project Staff (continued)Analysis Conducted by Project Staff

(continued)Reviewed RFC formsApplied criteria and methodology describedReached agreement/consensus


Example 1


PERSON-SIDE WORK-SIDE

OCCUPATIONAL INFORMATION DESIRED BY USERS

Data Element: Fine Manipulation Definition: Picking, pinching, or otherwise working primarily with fingers rather than with the whole hand or arm as in handling Related Inquiry: Is the person’s capacity for fine manipulation limited by a medically determinable impairment?

Dimension: Definition: Related Work Activities:

To assess disability for an individual with a limitation in fine manipulation, it would be helpful to know what is and what is not required by the occupation in terms of specific fine manipulation job demands. For example, users desire information about whether the job incumbent is required to use fine manipulation:

Bilateral vs. unilateral Fingering Handwriting Pinching (forceful, simple) Picking Using keyboard or other manual

input devices

Example 1 (continued)Data element is “fine manipulation,” as

recommended by the Workgroup Occupational information desired by users

identifies need for information about:Whether the work activity can be performed using

one arm/hand or whether both arms/hands are needed to perform the work activity, as recommended by the Panel and others

Specific types of fine manipulation, such as fingering, handwriting, pinching (simple, forceful), and using keyboard, mouse, touchpad or other manual input devices, as recommended by the Panel and others


Example 2Examples of data elements not selected

DizzinessStress


Next Steps“Identification of User Needs for Content Model

Development” is one of many steps in process of developing a final OIS content model.

Data elements, dimensions, and data elements for research purposes will need to be tested.

Testing may result in refinement to these data elements, dimensions, and data elements for research purposes.

This testing and refinement process will continue until the final OIS Content Model is an accurate and appropriate reflection of the adjudicative needs of SSA’s disability programs as well as the world of work.


september 2010 user needs identification for content model development oidap quarterly meeting...

Documents

research slide

research question

development of ois

question research purpose

programmatic needs development

ois development outreach

research purposes methods

user needs identification