School-based assessment
The Hong Kong Examinations and Assessment Authority has moved from norm-referenced to standards-referenced assessment, including the incorporation of a substantial school-based summative oral assessment component into the compulsory English language subject in the Hong Kong Certificate of Education Examination, a high-stakes examination for all Form 4–5 students.
Background
was first proposed in the Reform Proposals for the Education System in Hong Kong, published in September 2000. According to the proposal, the modes, content and the assessment methods of public examinations should be reviewed. A "core-competence" approach, similar to criterion-referencing, will be adopted. In this approach, basic skills and knowledge required by a Form 5 graduate will be indicated and students do not have to compare with the others. Under the education reforms in which a new culture of learning and teaching is to be cultivated, schools can use different modes of broad-based assessments, including observation of students' performance in classroom and participation in project work to promote learning in a more flexible manner. Another benefit is advocating students' all-round development which gives a more comprehensive picture of individual students' learning needs, as well as fosters the positive washback effects of public examinations. It also helps to address the limitations of judging students on their performance in one single examination.Rationales
The rationales laid down by the SBA Consultancy Team for implementing SBA are as follows:- to continuously assess students in a pressure-free environment;
- to reduce reliance on ‘one-off’ public oral examination;
- to improve the reliability of oral English assessment;
- to reflect the standard and ability of students;
- to foster teaching and learning;
- to promote students’ leisure reading and listening;
- to reinforce learners’ autonomy and independent learning;
- to facilitate "learning how to learn" by carrying out peer reviews and writing after a model in the assessment tasks and trainings;
- to inform prospective employers and universities the level performance of students; and
- to make Hong Kong's examination system in line with the international model so that 'assessment for learning' is achieved; and
- to empower teachers to make part of the assessment mechanism .
Content
The assessment format and requirements as originally specified in the introduction to the SBA in September 2005 are summarised in Table 1.
| Requirements | Form 4 | Form 5 | Total |
| No. and type of texts to be read | Minimum of two texts, from two categories | Remaining two texts, remaining categories | Four texts, one from each category |
| No. and timing of assessment, tasks to be undertaken | Minimum of two interactive tasks to be undertaken anytime during Form 4, must be on different texts | Minimum of one interactive task, one individual presentation to be undertaken anytime during F5, must be on different texts | Four tasks on four texts, one from each category |
| No., %, and timing of marks to be reported | One mark, best mark out of the two tasks, 5% of total English mark, reported at end of Form 4 | Best mark for the interaction and best mark for the presentation, 10% of total English mark, reported at end of Form 5 | 15% of total English mark |
Source:.
Assessment criteria
For assessment students are required to partake in interactions with classmates on a particular aspect of the text they have read or viewed, leading up to making a more formal group interaction or an individual presentation on a specific text and responding to questions from their audience. Students are assessed according to a set of assessment criteria, consisting of a set of descriptors at each of six levels across four domains. The domains are briefly described as follows:- Domain 1: Pronunciation and Delivery: Pronunciation comprises phonology and intonation.
- Domain 2: Communication Strategies: Communicative strategies involve body language, timing, and asking and answering appropriate kinds of questions.
- Domain 3: Vocabulary and Language Patterns: The vocabulary and language patterns domain consists of three important areas: vocabulary and language patterns, and self-correction/reformulation.
- Domain 4: Ideas and Organisation: The ideas and organisation domain consists of the expression of information and ideas, the elaboration of appropriate aspects of the topic, organisation, and questioning and responding to questions.
Future development
Controversies
Using Brindley’s framework, the SBA component is controversial in terms of political issues, to do with the purposes and intended use of the assessment; technical issues, primarily to do with validity and reliability; and practical issues, to do with the means by which the assessment was put into practice. These issues were gathered from key stakeholder groups, including teachers, students and education bureau officials.Politically, in Davison’s words, “In fact, the SBA guidelines asked teachers to set their own time limits according to the needs of the students, but this was interpreted through the prism of teachers’ existing experience—many schools used buzzers and stopwatches to allocate an identical period of time to each students, with the result that in some schools students’ stress levels were high and their “performance” very contrived and/or rushed. As an outcome-oriented standards-referenced system, SBA is a significant cultural and attitudinal change, not only for teachers but for the whole school community, including students and parents. Hence, it is not surprising that fairness was a deep-seated sociocultural, not just political concern."
Technically, many teachers and students are concerned over validity, reliability and fairness of the SBA component. While teacher-educators and researchers view that SBA will enhance the validity and reliability of the HKCEE theoretically, some frontline teachers and students are sceptical on this.
As for practical issues, teachers raised such concerns as:
- The need for access to appropriate assessment resources;
- The need for activities and techniques as models/resources;
- Concerns about the type of recordings of oral performance that they were expected to collect;
- Lack of practical support for teachers at the school level;
- Concerns about the adequacy of professional development in SBA;
- Lack of time to implement and discuss assessments; and
- Competing demands and priorities in relation to time allocation.