(3) public assessment – assessment design and the
TRANSCRIPT
NSS Assessing Student Learning for the
Business, Accounting and Financial Studies
Curriculum Series:
(3) Public Assessment – Assessment Design
and the Implementation of SBA (New)
1 November 2011
Program Rundown
Time Rundown Speaker /
Facilitators
2:00 – 2:15 Registration
2:15 – 3:15 School-based Assessment
– Design and Arrangement
Ms Clarie Chan Manager, Assessment
Development
Break
3:30 – 4:45 School-based Assessment
Implementation
– Strategies in Conducting SBA
Ms Mabel Lee Good Hope School
Mr Vincent Cheung Liu Po Shan Memorial
College
4:45 – 5:00 Q & A
Chinese Lang, English Lang, Liberal Studies, Chinese History, Design & Applied Technology, History, Information & Communication Technology, Visual Arts
Biology, Chemistry, Physics, Science
A
Chinese Literature, Economics, Ethics & Religious Studies, Geography, Health Management & Social Care, Technology & Living, Tourism & Hospitality Studies, Literature in Eng, Physical Education total of 23
Music
subjects have to
Business, Accounting & Financial Studies
2012 Implementation Partial
implementation
(laboratory work)
Deferred implementation submit Deferred
implementation SBA marks Deferred implementation
2013 Implementation Partial
implementation
(laboratory work)
Deferred implementation
Deferred implementation
Deferred implementation
2014 Implementation Implementation Implementation School trial School trial
2015 Implementation Implementation Implementation Implementation School trial
2016 Implementation Implementation Implementation Implementation Implementation
Guiding Principles:
Should not change the design principles of the curriculum
and assessment framework
Uphold the spirit of SBA – integral part of learning &
teaching and essential component of the public
assessment, with due consideration given to the interests and benefit of students
Streamlining through avoiding too much overlapping of SBA (minimising duplication of assessment effort within/across subjects), and reducing administrative work in conducting the assessments and submitting
marks, to make SBA more manageable for students and teachers but not at the expense of essential learning elements
7
Key Activities of a SBA Task (existing task requirements)
Key Activity 3: Participation in the assigned business
activity and/or information collection
• Take part in the business event assigned by the
teacher, e.g. actual venture, competition, training
program, visit, talk, etc.
• Collect primary and/or secondary data in accordance
with the decided theme/title
Key Activity 4: Initial analysis of results
• Note major findings and conduct preliminary analysis
• Submit Worksheet 3
Implementation Phase
Key Activity 5: Written presentation
• Apply and integrate business knowledge to the business
scenario under investigation
• Organise and present findings and recommendations
• Submit a written report (max. 3 pages)
Key Activity 6: Oral presentation
• Apply business presentation skills to report on findings
and recommendations
• Present individually to teacher and/or peers
• Respond to questions
Reporting Phase
Key Activity 1: Proposal of a theme/title for the SBA task
• Decide on the scope of work for the SBA task
• Submit Worksheet 1
Key Activity 2: Proposal of a theme/title for the SBA task
• Finalise questions for investigation
• Submit Worksheet 2
Planning Phase
Key Activity 7: Reflection on learning
• Reflect on aspects of knowledge and/or personal growth
• Identify limitations and propose improvements for future
studies
• Submit Worksheet 4
Evaluation Phase
Key Activities of a SBA Task (The streamlining proposal)
Key Activity 3: Participation in the assigned business
activity and/or information collection
•Take part in the business event assigned by the teacher,
e.g. actual venture, competition, training program, visit,
talk, etc.
•Collect primary and/or secondary data in accordance with
the decided theme/title
Key Activity 4: Initial analysis of results
•Note major findings and conduct preliminary analysis
Implementation Phase
Key Activity 5: Preparation of the written report
•Apply and integrate business knowledge to the business
scenario under investigation
•Organise and prepare findings and recommendations
Key Activity 6: Oral presentation
•Apply business presentation skills to report on findings and
recommendations
•Present individually to teacher and/or peers
•Respond to questions
Reporting Phase
Key Activity 1: Proposal of a theme/title for the SBA task
•Decide on the scope of work for the SBA task
Key Activity 2: Proposal of a theme/title for the SBA task
•Finalise questions for investigation
•Submit the Worksheet
Planning Phase
Key Activity 7: Reflection on learning
•Reflect on aspects of knowledge and/or personal growth
•Identify limitations and propose improvements for future
studies
•Submit a written report (max. 3 pages)
Evaluation Phase
g the w rk process, th marks on as clarity, completeness d relevance t
Mark allocation after streamlining
Marks Worksheets Oral
Presentation
Written
Presentation
Record of work process 10 � a
Business presentation skills 30 �
Business knowledge and understanding 25 �
Analytical skills for business decision-making 35 �
100
Note: a. The worksheet is meant to be a record of the planning process. Considering the tentative nature of the ideas alon o e 10 worksheets are awarded for general aspects such an o the curriculum.
The streamlining proposal (Summary)
Task Requirement
Worksheet 1 worksheet to be completed in class
Assessment weighting = 10%
Written Report 1 written report (max 3 pages)
Assessment weighting = 60%
Oral Presentation
An oral presentation, with a question and
answer session, of about 5 mins
Assessment weighting = 30%
Time Frame (1) May - Aug 2011: Formulating streamlining proposals by CDI and HKEAA
Sep – Oct 2011: Presenting the proposals to Principals’ Liaison Meeting, SBA Advisory Group, CDC-HKEAA Committees and Working Group on Piloting of SBA Sample Tasks for discussion
14 Oct 2011: Briefing sessions for school leaders
Oct – Nov 2011: Sharing the proposals with teachers at SBA subject conferences
Nov - Dec 2011: Consulting schools about the proposals
Jan - Feb 2012: Endorsement sought from the Public Examinations Board
Feb 2012: Informing schools of the finalised arrangements
t
Calendar of events (for 2014 HKDSE)
2nd erm 1st term 1st term 2nd term 1st term 2nd term
SBA
Streamlining
Proposal
Finalized
District
Coordinating
System
Established SBA Marks
Submission
2012 (S4)
2012 (S5)
2014 (S6)
2013 (S6)
2013 (S5)
2014
Date of Exam
Samples of
Student
Work
Submission Moderation
and
Sample
Review
Feedbacks
on
Moderation
to Schools
t
Calendar of events (for 2014 HKDSE)
2nd erm 1st term 1st term 2nd term 1st term 2nd term
District
Coordinating
System
Established
2012 (S4)
2012 (S5)
2014 (S6)
2013 (S6)
2013 (S5)
2014
Date of Exam
EDB
District Coordinating System
SCHOOL PRINCIPALS
STUDENTS
HKEAA
SCHOOL COORDINATORS
SBA SUPERVISORS / DISTRICT COORDINATORS
SCHOOL
TEACHERS
EDB
Roles of Coordinators and Supervisors
School
coordinators will:
�Be appointed by the school principal
�Liaise with HKEAA and the district coordinators
�Plan the school assessment schedule
�Coordinate the reporting of marks to HKEAA
�Report to the district coordinators any irregularities
SBA supervisors /
District
coordinators will:
�Monitor SBA and report irregularities to HKEAA
�Write reports on progress of SBA
�Meet with school coordinators / teachers to provide
guidance and receive comments
�Review samples of students’ work
t
Calendar of events (for 2014 HKDSE)
2nd erm 1st term 1st term 2nd term 1st term 2nd term
SBA Marks
Submission
2012 (S4)
2012 (S5)
2014 (S6)
2013 (S6)
2013 (S5)
2014
Date of Exam
SBA Marks Submission
1 mark on worksheet
1 mark on written report
1 mark on oral presentation
(School Trial) All marks submitted in S6
t
Calendar of events (for 2014 HKDSE)
2nd erm 1st term 1st term 2nd term 1st term 2nd term
2012 (S4)
2012 (S5)
2014 (S6)
2013 (S6)
2013 (S5)
2014
Date of Exam
Samples of
Student
Work
Submission
Samples of Student Work Submission
School basis
Stratified sampling
- 6 samples on worksheet
� If possible, schools should request their students to
submit/retain their work in digital format to facilitate easy retrieval/storage of the work
- 6 samples on written report
(HH, HM, MM, ML, LM, LL)
t
Calendar of events (for 2014 HKDSE)
2nd erm 1st term 1st term 2nd term 1st term 2nd term
2012 (S4)
2012 (S5)
2014 (S6)
2013 (S6)
2013 (S5)
2014
Date of Exam
Moderation
and
sample review
WWhhyy MMooddeerraattiioonn –– SSttaannddaarrddiissaattiioonn
bbeettwweeeenn SScchhoooollss
Teachers know their students well and are best placed to judge their relative performance
However, they may not be aware of the standards of performance across all schools
Some schools may be harsher or more lenient in marking and/or use a narrower or wider mark range
Standardisation across schools to ensure fairness
26
MMooddeerraattiioonn MMeetthhooddss Statistical moderation with an element of expert judgment
- Statistical moderation based on school exam results, follow up
with appropriate actions for outliers identified
- Moderation based on exam results appropriate for most schools,
but adjustment based solely on exam results may not fully reflect
students’ actual SBA performance in some schools
- Sample review to help identify outlier schools. For outlier schools,
adjustment will be carried out, if necessary, by considering a
number of factors, such as moderated marks based on exam
results and sample review findings so as to reflect the actual SBA
performance
Schools’ internal ranking remains unchanged
For details of the moderation mechanism, please refer to the booklet Moderation of School-based Assessment Scores in the HKDSE:
http://www.hkeaa.edu.hk/DocLibrary/SBA/HKDSE/HKDSE-SBA-ModerationBooklet_r.pdf 27
SSaammppllee ReRevviieeww
Purpose of sample review in the moderation process:
Outlier detection
• Identifying those schools where the standard of SBA work is significantly better/worse than their exam results suggested
Stratified random sampling
Random sampling:
Each student work in a school has a chance to be selected, which is a necessary condition for obtaining a representative sample (i.e., unbiased estimations)
Stratification:
Student works are divided into a number of strata, in each of which the performances of works are similar with each other (i.e., homogenous)
Some samples are selected from each stratum
Such an arrangement reduces sampling errors
28
t
Calendar of events (for 2014 HKDSE)
2nd erm 1st term 1st term 2nd term 1st term 2nd term
2012 (S4)
2012 (S5)
2014 (S6)
2013 (S6)
2013 (S5)
2014
Date of Exam
Feedbacks
on
Moderation
to Schools
Feedbacks on Moderation
Feedbacks on the outcomes of moderation will be provided at the beginning of the next school year
Public exam results of students will not be altered
t
How to Plan for SBA?
2nd erm 1st term 1st term 2nd term 1st term 2nd term
SBA
Streamlining
Proposal
Finalized
District
Coordinating
System
Established SBA Marks
Submission
2012 (S4)
2012 (S5)
2014 (S6)
2013 (S6)
2013 (S5)
2014
Date of Exam
Samples of
Student
Work
Submission Moderation
and
Sample
Review
Feedbacks
on
Moderation
to Schools
10 Sample Tasks BAFS SBA
http://www.hkeaa.edu.hk/DocLibrary/SBA/HK
DSE/SampleTasks-BAFS-E-290709.pdf
BAFS SBA Teachers’ Handbook (Trial Version)
http://www.hkeaa.edu.hk/DocLibrary/SBA/HK DSE/SBAhandbook-Trial-BAFS-E-230909.pdf
Contact us
Public Examination Information
Tel: (852) 3628 8860
E-mail: [email protected]
Operation of SBA Tel :(852) 3628 8070
E-mail :[email protected]