7/27/2019 Session 5ee

1/42

Principles of Assessment and Evaluation

CHARACTERISTICS

OF A GOOD ASSESSMENT

Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

7/27/2019 Session 5ee

2/42

Principles of Assessment and Evaluation

Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

Validity & Validity Types

Reliability & Reliability Types

7/27/2019 Session 5ee

3/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

validity

reliability

characteristics of a good assessment

7/27/2019 Session 5ee

4/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

Lets have a look

at thedefinitions

7/27/2019 Session 5ee

5/42

7/27/2019 Session 5ee

6/42

7/27/2019 Session 5ee

7/42

7/27/2019 Session 5ee

8/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

Hmm arentyou supposed to

have thedefinition with

you?

7/27/2019 Session 5ee

9/42

7/27/2019 Session 5ee

10/42

7/27/2019 Session 5ee

11/42

7/27/2019 Session 5ee

12/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

validity

Validity is the interpretation of theinformation that the test generates.

It refers to the accuracy of theinterpretation.

7/27/2019 Session 5ee

13/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

validity

For example, a driving test must include acompetency-based assessment whichrequires the candidates to drive a vehicle

in a real setting.

7/27/2019 Session 5ee

14/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

Can you think of examples of valid or invalid measures for test?

QUESTION

7/27/2019 Session 5ee

15/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

validity of assessment

Validity of any assessment is dependentupon the purpose of the assessment andthe way in which evidence is interpreted

and used by the key stakeholders.

7/27/2019 Session 5ee

16/42

7/27/2019 Session 5ee

17/42

7/27/2019 Session 5ee

18/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

face validity

content validity

construct validity

validity types

criterion validity

consequential validity

7/27/2019 Session 5ee

19/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

face validity

At surface level, the assessmenttranslates sufficiently the content and

construct being assessed.

7/27/2019 Session 5ee

20/42

7/27/2019 Session 5ee

21/42

7/27/2019 Session 5ee

22/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

construct validity

It refers to the degree to which theinferences can legitimately be made.

Applicable when there is no obvious

body of content or when there are noexisting criteria.

7/27/2019 Session 5ee

23/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

construct validity

The extent a variable is abstract ratherthan concrete, we speak of it as being a

construct .

Such a variable is literally a construct inthat it is something put together from

their own imaginations.

Numally, J.C. (1978) Psychometric Theory

7/27/2019 Session 5ee

24/42

7/27/2019 Session 5ee

25/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

criterion validity

two types of criterion validity:

predictive validity

concurrent validity

7/27/2019 Session 5ee

26/42

7/27/2019 Session 5ee

27/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

concurrent

Occurs when the criterion measures areobtained at the same time as the test scores.

The ability of a measure to indicate anindividuals present standing on the criterion

variable.

criterion validity

7/27/2019 Session 5ee

28/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

reliability

7/27/2019 Session 5ee

29/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

reliability

Reliability is the ability to controlbackground noise.

7/27/2019 Session 5ee

30/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

inter-rater (across assessors)

intra-rater (within assessor)

parallel forms (across tasks)

reliability types

split halves (within task)

internal consistency (within task)

7/27/2019 Session 5ee

31/42

P i i l fA d E l i

7/27/2019 Session 5ee

32/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

intra-rater reliability

Consistency of assessment outcomesacross time and location, and using the

same assessment task administered bythe same assessor.

P i i l fA d E l i

7/27/2019 Session 5ee

33/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

parallel forms reliability

Assessing two different assessments withthe purpose of obtaining consistent

results.

P i i l fA t d E l ti

7/27/2019 Session 5ee

34/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

internal consistency reliability

Concerned with how well the items ortasks act together to elicit a consistent

type of response.

PrinciplesofAssessment and Evaluation

7/27/2019 Session 5ee

35/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

The method used to collect the evidence

will impact on reliability .The way in which the assessor uses and

interprets the evidence collected willimpact on validity .

PrinciplesofAssessment and Evaluation

7/27/2019 Session 5ee

36/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

validity or reliability?

PrinciplesofAssessment and Evaluation

7/27/2019 Session 5ee

37/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

validity or reliability?

PrinciplesofAssessment and Evaluation

7/27/2019 Session 5ee

38/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

validity or reliability?

PrinciplesofAssessment and Evaluation

7/27/2019 Session 5ee

39/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

Practicality

PrinciplesofAssessment and Evaluation

7/27/2019 Session 5ee

40/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

In addition to validity and reliability,considerations must also be given to the

aspect of practicality.

PrinciplesofAssessment and Evaluation

7/27/2019 Session 5ee

41/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

practicality

Considerations given to theoperationalization of an assessment (i.e.

cost, stake, worth) which may also affectdecisions on validity and reliability.

PrinciplesofAssessment and Evaluation

7/27/2019 Session 5ee

42/42

Principles of Assessment and Evaluation

CHARACTERISTICS OF A GOOD ASSESSMENT Created bt Zuraimi ZakariaNot to be distributed or reproduced without permission

session five

end of session five