2, 1
Очень сильные
Силь
-
ные
Сла
-
бые
Не пре
-
до
ст
ав
-
лено
71
В3
3.1
3.2
Оценивание: За
писи фор
м
ативног
о и с
умм
ативног
о оценивания.
Оценивание: За
писи по 2 фор
м
ативным и 2 с
умм
ативным оцениваниям.
а)
Дв
е
за
писи
с
док
аза
тельств
ом
испо
льз
ов
ания
фор
ма
тивног
о
оценив
ания
в
вашей прак
тик
е:
•
как
Вы
испо
льз
ов
али
фор
ма
тивно
е
оценив
ание
в
те
чение
4
се
ссий
с
учи
-
телями; • к
ак
Вы
испо
льз
ов
али
фор
ма
тивно
е
оценив
ание
в
проце
сс
е
соз
дания
учите
-
лями пор
тфо
лио док
аза
тельств.
Приме
чание
:
За
писи
до
лжны
вклю
ча
ть
в
себ
я
от
зывы,
ко
торые
были
даны
учителям.
В
кра
тк
ом
ко
ммент
арии
(250
слов)
необ
хо
димо
об
ъяснить,
по
чему
был выбран т
от или иной по
дх
од (ы).
б) Дв
е за
писи испо
льз
ов
ания с
умм
ативног
о оценив
ания:
•
пор
тфо
лио
учителей
(р
убрики
су
мм
ативног
о
оценив
ания
тренера
гр
уппы
и не
зависимог
о т
ренера);
• пре
зент
ации учителей по со
ст
ав
ляющим пор
тфо
лио док
аза
тельств
ам.
2, 1
Очень сильные
Силь
-
ные
Сла
-
бые
Не пре
-
до
ст
ав
-
лено
В4
Оценивание к
аче
ства (эва
люация)
Отчет
с
ре
ф
лек
сией
над
про
ве
денными
четырьмя
об
учающими
се
ссиями
(1500 сло
в), оценивающий:
•
успешно
сть об
учения учителей в х
оде занятий;
o
были
ли
до
стигнуты
вс
е
цели
и
зада
чи,
если
да,
то
как,
если
нет
, т
о
по
-
чему
;
o
Были
ли
удов
летв
орены
по
требно
сти
учителей
в
индивиду
ально
м
поряд
-
ке и в к
аче
ств
е гр
уппы, е
сли да, т
о к
ак, е
сли нет
, т
о по
чему
;
o
Были
ли
учителя
вов
ле
чены
в
об
учение
и
были
ли
они
заняты
выпо
лняя
упражнения, в те
чение в
се
х 4 с
ессий
o
были
ли
учителя
смо
тивиров
аны
на
об
учение
и
прих
одило
сь
ли
им
мыс
-
лить критиче
ски, е
сли да, т
о к
ак, е
сли нет
, т
о по
чему
;
o
ст
ало
ли
препо
дав
ание
и
об
учение
бо
лее
эф
фек
тивным
с
испо
льз
ов
анием
конст
рук
тивист
ских по
дх
одов, е
сли да, т
о к
ак, е
сли нет
, т
о по
чему
;
3, 1
Очень сильные
Силь
-
ные
Сла
-
бые
Не пре
-
до
ст
ав
-
лено
72
o
спо
собств
ов
ало
ли
вне
дрение
фор
ма
тивног
о
оценив
ания
в
се
ссии
по
мо
-
нит
орингу
и
по
ддержк
е
об
учения
учителей,
если
да,
то
как,
если
нет
, т
о
по
чему
;
o
по
мог
ли
ли
об
учающие
ма
териа
лы,
ре
сурсы
и
сре
дств
а
пров
одить
по
д-
держк
у об
учения учителей, е
сли да, т
о к
ак, е
сли нет
, т
о по
чему
;
•
сильные
и
слабые
ст
ороны
в
собств
енно
м
планиров
ании,
препо
дав
ании
и
оцено
чной
прак
тик
е
во
время
об
учения
учителей
новым
пе
даг
огиче
ским
по
дх
одам.
С С1
Ре
ф
лек
сия и развитие
Ре
ф
лективный
отчёт
(1500)
об
об
учении
тренера
и
из
менении
бу
дущей
практики,
со
держащий инфор
мацию о:
•
то
м,
чт
о
тренер
узна
л
по
ит
огам
ре
ализ
уемой
прак
тики
чере
з об
учение
тре
-
неров
и
учителей,
ре
флек
сию
над
обра
тной
св
язью
из
различных
ист
очни
-
ков вклю
чая учителей, наб
лю
да
телей, к
оллег
, Р
еф
лек
тивный Ж
урна
л и т
.д.;
•
то
м,
как
из
менит
ся
бу
дущая
прак
тик
а
в
ка
че
ств
е
тренера
в
ре
зу
ль
та
те
ре
ф-
лек
тивног
о
мышления,
рук
ов
одств
а
и
рабо
ты
с
современными
теориями,
идеями
и
по
дх
одами
к
препо
дав
анию
и
об
учению
–
как
эти
идеи
образ
ую
т
основ
у и по
могаю
т с
фор
миров
ать б
удущие об
учение и прак
тик
у;
•
конкретных
из
менениях,
за
планиров
анных
в
бу
дущей
прак
тик
е
тренера
и
нацеленных
на
по
мощь
учителям
в
их
ст
ремлении
ст
ать
от
личным
профе
с-
сиона
ло
м.
3, 1
Очень сильные
Силь
-
ные
Сла
-
бые
Не пре
-
до
ст
ав
-
лено
73
Приложение 4
Определение ролей
Экзаменационный
Совет по сертифи-
кации тренеров и
экспертов
(Экзаменационный
Совет)
Экзаменационный Совет отслеживает все процедуры оценивания
и принимает окончательное решение по сертификации, а после ут-
верждает списки на получение сертификатов.
Главный эксперт
Лицо, назначенное ЦПИ и отвечающее за общее качество системы
оценивания в целом, последовательность и точ- ность оценива-
ния тренеров и экспертов, руководит всей командой экспертов по
оцениванию, осуществляет сум- мативное оценивание докумен-
тов портфолио экспертов и тренеров (при необходимости). Может
осуществлять функции председателя Комиссии по оцениванию
учителей/тренеров/экспертов и Экзаменационного Совета по сер-
тификации.
Тимлидер
группы
экспертов
(тимлидер)
Эксперты сформированы в группы по направлениям де- ятельно-
сти, по языку и региону проживания и в каждой группе определя-
ется тимлидер. Тимлидер несет ответ- ственность за работу всей
команды и отчитывается Глав- ному эксперту
Эксперт по
оцениванию
Эксперты ЦПИ, которые несут ответственность за оцени вание и
менторинг тренеров, а также за модерацию оценивания портфолио
и презентаций учителей.
Тренер
Тренеры назначаются ЦПМ и являются ответственными за плани-
рование, подготовку, преподавание и оценивание учителей в Про-
граммах повышения квалификации
74
75
In-service training programme for the pedagogic staff
of the Republic of Kazakhstan
AEO “Nazarbayev Intellectual Schools”
Center of Excellence project
Trainer Assessment
Model
Second edition
76
Recommended for publishing by
“Center for Pedagogical Measurements” branch
under the AEO “Nazarbayev Intellectual Schools”
© Nazarbayev Intellectual Schools, 2015
All rights reserved. No part of this publication may be reproduced or transmitted in
any form or by any means, including photocopying and recording, without the written
permission of the copyright holder.
77
78
Trainer Assessment
Contents
1 Introduction
83
2 Assessment of Portfolios
84
2.1 Principles for the assessment of portfolios 84
2.2 Portfolio content 84
2.3 The process of assessment of portfolios 86
3 Formal approval of the pass list, re-submission and appeals
90
4 Quality assurance
91
5 Recertification
92
5.1 Evidence of ongoing development at the same level
of programme for trainers 92
5.2 Portfolio of evidence for recertification for trainers 92
Appendix 1: Standards for trainers
93
Appendix 2: Trainer portfolio content
97
Appendix 3: Rubrics for assessing trainers' portfolios of evidence
101
Appendix 4: Role definitions
114
79
1 Introduction
The trainer and Expert assessment model has been designed to be as fair and accountable
as possible and is based on the assessment principles of validity, reliability, sufficiency
and authenticity.
In the Centres of Excellence (CoE) system, assessment is integral to learning and the trainer
and Expert assessment has been designed to support effective professional learning and
practice. Everyone involved should understand and value assessment, whether formative
or summative, recognising that it is part of learning and should not be at the expense of
learning.
This is evident in aspects such as:
• clearly defined professional standards;
• key assessment criteria;
• formative assessment through mentoring;
• summative assessment of a range of evidence produced by the trainer or Expert
drawn from her/his professional thinking and practice.
Assessment needs to be as relevant and meaningful as possible. The activities which
provide evidence for assessment are an integral part of one’s professional development
and professional work (and indeed can help in carrying out this work, e.g. providing a
framework for planning). Assessment also needs to be clearly differentiated as either
formative or summative in purpose, and based on evidence that is manageable. There
needs to be clear coordination between assessment criteria and types of evidence, so that
the Experts know what to look for, and where and how to look. An important principle
of the assessment model is that it is criterion-referenced. This means that if a trainer or
Expert evidences all the specified criteria to the standard required they will succeed.
To deliver the training programmes for teachers requires a group of highly motivated
trainers who understand and are skilled in the new approaches to teaching and learning.
The trainers also have a crucial part to play in assessment of the teachers’ learning and
practice using assessment criteria derived from the teacher standards.
As well as evaluating a teacher’s learning, trainers also evaluate their own learning and
practice and in doing so compile their own portfolio of evidence to demonstrate the
quality of their work as trainers. The trainers’ learning and practice is assessed by Experts
using the same key assessment criteria as for teachers. When they satisfy the criteria, they
are certificated as CoE trainers.
Assessment of trainers and Experts is therefore aligned with teacher assessment, and based
on the same educational values and principles. The approach to designing and managing
trainer assessment is itself aligned to the CoE vision, principles of teaching, learning
and assessment, and aims to support the development of a professional community that
shares core values, knowledge, understanding, skills and practice.
80
2 Assessment of Portfolios
2.1 Principles for the assessment of portfolios
The CoE teacher development programme aims to develop understanding of new
approaches to teaching and learning to change the thinking and practice of teachers and
trainers across Kazakhstan. This requires an assessment process that is both formative, in
order to support professional learning which will lead to development and change, and
summative in order to assess what professional learning has occurred at a specific point.
The programme is intended to promote sustained development in the practice of teachers,
trainers and Experts. Assessment therefore focuses on determining whether they have
actively engaged with ideas from the programme and on whether they are developing
their practice in line with the new approaches to teaching and learning discussed within
it. Evidence should indicate that developments in the teachers’, trainers’ and Experts’
understanding and practice are likely to be sustained and they underpin the success
criteria for the programme.
Trainer assessment, as teacher assessment, is carried out in relation to three key criteria
and should demonstrate that:
1. Trainers have gained knowledge and understanding of the key ideas presented
in the programme;
2. Trainers are applying these ideas within their own practice;
3. Trainers are reflecting on the implementation of new practices and considering
implications for further development.
The trainer’s learning and practice is summatively assessed by a local and an independent
Expert on the basis of a portfolio of evidence, using the same key assessment criteria as
those applied to teachers.
When trainers have evidenced that they satisfy the assessment criteria and standards they
become accredited trainers and are awarded certificates bearing the certification marks of
CPM under the Autonomous Educational Organisation ‘Nazarbayev Intellectual Schools’
and Cambridge International Examinations. Initial certification is awarded to a Trainer,
without specification of the particular level of programme involved. CPM is responsible
for the certified Trainer receiving further attestation documents referring to the trainer
training on level(s) of programme different from their initial programme.
CPM will record trainer details, certificate numbers and training levels achieved in a
register. CPM is responsible for notifying Centres of Excellence concerning the Trainers
pass list and outcomes of accreditation.
2.2 Portfolio content
The standards for trainers are included as Appendix 1. The standards are expressed in
terms of the skills, knowledge and understanding required in effective performance and
81
are underpinned by a set of professional values. These values are not directly assessed
but are embedded in the performance criteria.
The standards are differentiated by the level of training programme. This means Level 2
trainers should have already met the standards for Level 3 trainers, and Level 1 trainers
should have met the standards at Levels 3 and 2.
In these standards the teachers whom the trainer is teaching are referred to as learners.
The portfolio should be a concise and coherent representation of a trainer’s knowledge,
practice and development.
Each portfolio has three sections:
A Knowledge and understanding of key ideas
B Effective practice
C Reflection and development
In the portfolio cover sheet a trainer initially needs to provide brief but relevant contextual
information such as her/his:
• professional background including experience as a teacher and/or a trainer
• the institution in which s/he is working
• current role and responsibilities
• brief profile of assessed group (of teachers).
The trainer portfolio contents for initial certification are listed in detail in Appendix 2 and
an overview is provided here:
Section
Words
A
A1
A1
A2
A1
A2
A3
A4
Knowledge and understanding of key ideas
For Level 3:
Action research project report
For Level 2
Reflective accounts of two coaching sessions
Analytical accounts of mentoring process
For Level 1
A reflective account of the ‘condition’ of the school
A reflective account of what changes need to be made
A detailed reflective account of the school development planning
process
A detailed analytical account of the evaluation plan
4000
2500
1500
1000
1000
1000
1000
82
B
B1
B2
B3
B4
Effective practice
Planning: records of planning from 4 sequential sessions
Teaching: records of critical events from the 4 taught sessions
Assessing: records of 2 formative and 2 summative assessments
Evaluating: report that evaluates the 4 taught sessions
250
250
500
1500
C
C1
Reflection and development
Reflective account of own learning and how future practice will
change
1500
Total
8000
2.3 The process of assessment of portfolios
2.3.1 Initial assessment of portfolios
To evidence the standards and satisfy the assessment criteria each trainer must produce
a portfolio of evidence of their learning and practice. This will be summatively assessed
by her/his local Expert and then by an independent Expert.
The summative assessment of a trainer’s portfolio is first carried out by the local Expert.
The organisation of the portfolio will be the trainer’s responsibility but to help them, and
the Expert, easily locate the minimum evidence requirements the appropriate assessment
rubric should be used. This rubric can be used for both summative and formative feedback
purposes. Requirements for Trainer portfolio assessment are in Appendix 3
An Expert is also present at the teacher portfolio presentations and can check that trainers’
summative assessment decisions are consistent, accurate and fair, advising and, when
necessary, moderating these decisions. The results of assessment are sent to the trainer
and summarised on the web portal.
The Expert should consider the portfolio holistically in order to decide whether there is
sufficient evidence that a trainer has addressed the three key criteria. This will involve a
degree of professional judgement. The grades available to the Expert to award are Pass
and Fail.
• For a Pass, the trainer needs to prove to the Expert that s/he has satisfied the key
assessment criteria.
• If s/he has significantly fallen short, e.g. weak, irrelevant or missing items of
evidence, the Expert should award Fail.
83
2.3.2 Independent assessment of portfolios
Before the trainer’s portfolio is assessed by the independent Expert, it should be
anonymised by withdrawing personal information such as the name of the trainer, course
centre, region of practice, or photographs. The independent Expert, who is not the trainer’s
mentor, will assess the portfolio on its merits, without any intervention or other influence
from the local Expert. The independent Expert awards a Pass or Fail.
2.3.3 Moderation
Moderation needs to take place if there is a difference between the assessments made
during the initial and independent assessments. The portfolio needs then to be assessed
again and a final recommendation made. In the case of a trainer portfolio, this is done by
a team of two independent Experts. If this team cannot agree, the decision is referred to
the Team Leader, and if it is still not clear what the appropriate decision should be, to the
Principal Expert.
It should be noted that moderation is done objectively against the assessment rubric and
criteria and on the basis of the evidence in the portfolio. There is not a standard formula
involved. For example, if the outcome of the local Expert assessment is Pass, and of the
independent Expert assessment Fail, this will mean moderation is required, but does not
predetermine what the outcome of moderation will be.
Moderation is an essential part of the assessment process, to ensure fairness, reliability
and other vital principles are met. It is also an opportunity for everyone involved in the
assessment process to develop their understanding of the standards, the application of
criteria and the interpretation of evidence. We can then feedback what we learn from the
experience into improved assessment practice.
Достарыңызбен бөлісу: |