brief history purpose of the standards having guidelines to evaluate and improve test services can...

39
Standards, Standards the Whole Day Through: How They Can Help Your Test Center Vicki Black, The University of Memphis Gayle Veltman, Wichita State University

Upload: breana-hanes

Post on 30-Mar-2015

227 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Standards, Standards the Whole Day Through: How They Can HelpYour Test Center

Vicki Black, The University of MemphisGayle Veltman, Wichita State University

Page 2: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Brief history

Purpose of the standards

NCTA Standards and Guidelines

Page 3: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement.

Improving testing services can be complicated

Page 4: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

The attendee will gain an understanding of the standards and guidelines for post-secondary test centers to improve his/her test center.

The attendee will learn how to subscribe to the NCTA Standards and guidelines.

After this session, the attendee will subscribe to the NCTA Standards and guidelines.

Objectives of this presentation

Page 5: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

NCTA Professional Standards and Guidelines for Post-Secondary Test Centers

Selected NCTA Standards for Use in a Certification Process

Documents to review

Page 6: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Overview the structure of the documentBenefitsStandardsGuidelines

Understanding the NCTA Professional Standards

Page 7: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

The standards and guidelines are intended to serve as a model for post-secondary test centers in the delivery of quality national testing services.

The standards and guidelines endorse requirements without directly enforcing them, allowing discretion appropriate to specific programs.

Please remember:

Page 8: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Benefits of adhering to the NCTA StandardsTo examineesTo test companiesTo test centersTo institutionsTo NCTA

Benefits

Page 9: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Policy

Contractual agreements

Staffing

Institutional Representation and

Coordination

Physical environment

Five sections of the Standards

Page 10: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Intended to be standards of achievement Guidelines are listed as objectives rather

than instructions for a specific task. Paper-based testing Computer based testing

Guidelines for Test Centers

Page 11: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Chosen by the Certification Committee as important for all test centers

For test centers trying to become certified, these standards will guide the organization of basic operational procedure and documentation

All standards are taken from the larger document of standards and guidelines

Standards for test center certification

Page 12: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Mission Statement

Physical Facilities

Test Integrity

Confidentiality

Staff Training and Procedures

Selected Standards for Certification

Page 13: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Program Evaluation

Testing Agreements/Contracts

Test Center Staff

Services Provided

Public Relations

Selected Standards for Certification(continued)

Page 14: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Why would you want to “subscribe”? Go the NCTA website at

www.ncta-testing.org/ Log In Click Resources, the NCTA Standards Read the introduction, standards, and

guidelines thoroughly, taking time to consider how to implement them at your test center.

Then go to the drop down box at the bottom and take the action you wish (subscribe or do not subscribe at this time).

Subscribing to the NCTA Standards

Page 15: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

The standards and guidelines are intended to serve as a model for post-secondary test centers in the delivery of quality national testing services.

The standards and guidelines endorse requirements without directly enforcing them, allowing discretion appropriate to specific programs.

There are no perfect test centers.

Remember

Page 16: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Rules of the gameEveryone in room put session handouts away

3 people on each of the 2 teams30 seconds to answer each question

Newly-Read Game Show

Page 17: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Scoring: each team gains points by correctly answering questions

The team with the most points at the end of the game wins.

Each team is assigned a question to answer. There will be a captain for each team who will provide the final team answer.

If the addressed team cannot correctly answer a question, no points are gained and presenter gives the correct answer. Then the second team attempts to answer the next question.

Newly Read Game Rules

Page 18: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

T or F The standards were created solely by the major testing companies so that test centers could set goals for improving services.

1. Benefits Question

Page 19: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

T or F The NCTA Professional Standards and Guidelines for Post-Secondary Test Centers were developed seven years ago.

 

2. Benefits Question

Page 20: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Name one group that can benefit from the use of the NCTA Standards.

3. Benefits of Subscribing

Page 21: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Name another group that can benefit from the use of the NCTA Standards.

 

4. Benefits of Subscribing

Page 22: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

The standards are organized into five sections.

  Name one of the sections of the standards

for one point.

5. General Info about the Standards

Page 23: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Which statement about the policy standards concerning high quality operations and ethical practices does not belong?

1. Maintain adequate physical facilities and location suitable to the requirements of the testing program.

2. Operate in a diligent manner to promote honesty, integrity, and fairness in all testing procedures.

3. Protect the confidentiality and rights of privacy of examinees and staff when allowing lists of examinees’ information to be sold to marketing firms to provide income for the test center.

4. Protect the integrity of the test. 

6. Policy Question

Page 24: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Which statement is not proper?  

1. Treat examinees in a fair, courteous, professional, and nondiscriminatory manner.

2. Testing relatives under standardized conditions, whether paper and pencil or computer based, provides an opportunity for family members to see test center staff in a new role of authority.

3. Make referrals to other campus offices and testing resources, as needed to provide students and clients with the most appropriate services of the institution and community.

4. Address examinee concerns with empathy while maintaining the integrity of the administration.

 

7. Policy Question

Page 25: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

T or F Testing companies will send contracts to test centers to establish agreements for distance learning testing.

8. Contractual Agreements

Page 26: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

T or F For contractual agreements between testing companies and test centers, specifics must be disclosed to test centers in advance to allow for any exceptions or special agreements to be negotiated.

9. Contractual Agreements

Page 27: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

T or F Payment for delivery of testing services may be to the test center or its institution, to individuals, or to both, depending on the contract.

 

10. Contractual Agreements

Page 28: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

T or F One common aspect of contracts is that a mandatory token payment system will not be allowed regardless of circumstances.

11. Contractual Agreements

Page 29: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

T or F It is not necessary to have one person as the designated head of a test center, since usually it takes a team to administer the various testing programs.

12. Staffing Question

Page 30: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

T or F The testing operations manager (head of the test center) is the primary institutional contact with the testing company and is ultimately responsible for the appropriate administration of testing programs.

13. Staffing Question

Page 31: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

T or F The testing operations manager should participate in professional development activities to stay current with trends in testing.

14. Staffing Question

Page 32: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

T or F The testing operations manager alone should be knowledgeable about test policies and processes.

 

15. Staffing Question

Page 33: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Which does not belong? Test center personnel are encouraged to make

formal and informal connections across the campus

1. To inform others about testing services2. To promote appropriate interaction between the

test center and other institutional departments3. To provide an opportunity for staff to take a break

from testing in the office4. To assure effective facilitation of test

administration

16. Institutional Representation and Coordination Question

Page 34: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Choose the statement that is not true. To achieve efficient, reliable, and timely test administration, the test center must:

1. Develop effective working relationships with faculty and institutional departments.

2. Become part of the Academic Affairs division on campus

3. Collaborate and communicate with faculty and academic departments about policies and procedures for the administration of classroom exams

4. Maintain appropriate records (e.g. test tracking logs, program statistics, and exam scores).

17. Institutional Representation and Coordination Question

Page 35: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Which is not correct?

1. All testing materials and computers used in testing must be kept in a locked vault with only one person on campus having access.

2. The conditions under which tests are handled, stored, and administered are extremely important.

3. Stored test materials must be in a locked space with no insecure points of access (no windows, transoms, false ceilings, etc).

18. Physical Environment Question

Page 36: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Which of these are things that the Testing Operations Manager and/or staff must do (concerning physical facilities):

1. Maintain a distraction-free testing environment; anticipate outside factors that may divert the attention of examinees, and take action to avoid these.

2. Consider room temperature; attempt to correct as needed. 3. Assure adequate lighting (using established guidelines). 4. Provide adequate test room(s)/space for given volume. 5. Provide seating and writing surfaces appropriate for test volume,

test materials, candidate characteristics, ADA, and other special requirements.

6. Seat examinees according to company specification to limit their view of others' work.

7. Check facility to assure readiness for testing. 8. Have backup plans in case of emergency or problem, if possible.

Contact company about shift to any backup plan.

19. Physical Environment Question

Page 37: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

T or FProviding special accommodations is ideal

for a test center but it is not required. It is the responsibility of the person with disabilities to find other locations for approved accommodations.

20. Physical Environment Question

Page 38: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

T or F Specific computer equipment may be

dedicated for use by one company’s programs or, if agreed to by the test center and companies, some equipment may be designated for use by multiple companies.

21. Physical Environment Question

Page 39: Brief history Purpose of the standards Having guidelines to evaluate and improve test services can be beneficial in discovering areas for improvement

Access to the test site requires that:1. ADA requirements are met.2. Adequate parking is available.3. Both of the above.

22. Physical Environment