Summative Assessment and Evaluation
Assessment is either Formative or Summative.
“The purpose of Summative Assessment is
protection of patients and the regulation of the profession.”
JCPTGP 1995. Summative Assessment is the time- honoured method of
hurdles in our educational career such as examinations. We endeavour to make
them as relevant to everyday general practice so that the preparatory work
will be useful in the future.
“The purpose of Formative Assessment is
education.” JCPTGP 1992. Formative Assessment is a continuous
process of interaction between teacher and learner, the needs and wants of
the registrar are explored and the means identified to successfully fill
these gaps.
Evaluation is the feedback loop to assessment.
It is the way of improving the quality of the teaching provided both within
general practice and the half-day release course. The VTS scheme welcomes
full and frank evaluation of the education that you receive. As Course
Organisers they are always looking for positive and negative feedback to
make the Bristol Vocational Training Scheme better. You never know they may
even make it the best!
SUMMATIVE
ASSESSMENT
On taking up your GP
Registrarship you will be sent a large blue folder detailing Summative
Assessment. Only an outline is given here and a
calendar. There are four elements to Summative Assessment:
1. MCQ
This tests your
knowledge base. The exam is held 4 times every year and is free to
registrars. Passing the MCQ component of the MRCGP allows exemption from
this part of Summative Assessment and because of this some registrars just
do the MRCGP and not the MCQ for Summative Assessment. Most feel that it is
best to hedge their bets and take both, especially as the Summative
Assessment MCQ is free.
2.
Video Consultation
At present, the MRCGP and Summative
Assessment requirements are different but they are converging. Summative
Assessment is a test of minimal competence whereas the MRCGP marking
structure is designed to separate out the candidates based on the quality of
material submitted for examination. Your video, if you are taking the MRCGP
can be submitted, and if you pass, automatically passes summative
assessment. Alternatively if you do not want to take the MRCGP at that time,
the tape can be submitted for summative assessment only .On the half-day
release course they run sessions on video assessment to fully acquaint you
with the current criteria.
** If you are taking the MRCGP
examination it is best to concentrate on collecting video material for
submission for the examination but also retain a duplicate tape.
** In order to collect the number of
cases required it is best to regularly video surgeries every week , ensuring
that your Receptionists are briefed, so that patients will readily consent
to being videod having been informed previously by the Receptionists that
this is a video surgery.
** Beware of the perfect consultation. No
one has yet performed such a feat and probably never will.
** Use the log to explain your
understanding of this interactive process, and fill in information the
examiner may not be aware of.
3.
Audit
Many audits are referred because they
do not fulfil the criteria laid down but in themselves are absolutely superb
pieces of work.
** Ideally perform your audit early in
the year and get it out of the way.
** Keep it simple while fulfilling the
criteria.
** The audit now involves 8 criteria and
a complete audit cycle.
** Look at previous audits that have
been submitted and passed.
4.
Structured Trainers Report
This is similar to the
modified Manchester Rating Scales but expanded. Your trainer is sent a copy
of this hefty document and it is worthwhile scanning through its contents to
give you some idea of how the JCPTGP interprets a good quality Registrarship.
The report should gradually be completed during the year by your trainer who
should let you know if there is any reason why it can not be satisfactorily
completed.
Within 1
month of completion of your Registrar year your trainer can complete
Form VTR1. This confirms satisfactory
completion of the GP component of Vocational Training. VTR1 and VTR2s are
then sent to the Director for authorisation (his signature) and sent back to
you. It is then up to you to forward these to the JCPTGP at the RCGP
for application of your final certificate of completed training which is
essential for practising as a GP after your Registrar year is completed.
The certificate will be returned to you after 2 weeks.
**
Have all of your VTR2 forms from your previous hospital jobs completed. If
there is likely to be any problems with your hospital posts (e.g. foreign
posts) check acceptance with the JCPTGP early.
FORMATIVE ASSESSMENT
Within the blue folder of Summative Assessment is a
section for Formative Assessment (which you will have already received).
There is no doubt that this is essentially a continuous process but from
time to time it is worth while stopping and just taking stock of the
situation to see exactly where you are. We would normally recommend that
this occurs about 3 times a year in conjunction with your trainer. At the
time of this regular review you may consider asking your trainer what the
practice sees as your strengths and ways in which you could improve during
the remainder of your training year. Similarly, feedback to your trainer
what you feel are the strengths and ways in which the practice can improve
your Traineeship. This may seem rather threatening at first, but in fact
unless this two way process takes place, both parties are likely to feel
dissatisfied with unfulfilled agendas at the end of the year.
You will be encouraged to keep a portfolio of
learning as you progress through the year. This will be essential for your
future career as a GP it is now requirement you leave the scheme with a
personal learning plan.
Every three months the course organiser who
facilitates your group will organise to see you on a personal and
confidential basis to discuss how things are going and resolve as many
issues as soon as possible.
(assessment form)
At six months into your year the course organiser
will phone up your trainer to make sure that things are going well and
ensure that you are on course for satisfactorily completing the year.
(assessment
form)
EVALUATION
The
organisers very much welcome, and are open to feedback. They do
take notice of what you say and the following years programme is altered in
line with the comments that they receive year on year. If the day was so bad
that you feel that it could not possibly be resuscitated then do say so. On
the other hand, if you feel that there are positive improvements which could
be made we will do our best to ensure these are incorporated into the next
year’s programme. They accept criticism in any form whether it is written or
verbal; they will even accept gestures. If you prefer, give your views to
the nominated Registrar on the Regional Postgraduate Education Committee or
the VTS course planning representative who can pass on your views on your
behalf. (evaluation form)
|