L. Hillier

The OSCE Marathon:
A Novel Exam
Preparatory Workshop
Linda Hillier MD FRCPC
September 30, 2016
I do not have an affiliation (financial or otherwise) with a
pharmaceutical, medical device or communications organization.
Je n’ai aucune affiliation (financière ou autre) avec une
entreprise pharmaceutique, un fabricant d’appareils
médicaux ou un cabinet de communication.
2
Background/Introduction
• Preparedness
• Confidence
• Stress
• Knowledge gap
Goal: evaluate effectiveness of workshop on these
parameters
3
Novel OSCE Workshop
Context
• 31 stations divided over 2 weekends No
simulated patients
• Each station 45-50 minutes-including
post performance peer and faculty
feedback
• Post weekend access to electronic
portal housing the stations
4
Novel OSCE Workshop
Context
• Scenario
General approach: History/Physical
Investigations
• Additional Information Provided
Diagnosis/Differential Diagnoses
Management/Counselling
• Related Topic Questions
5
Methods
• 2 successive cohorts of residents/ fellows
preparing for the RCPS exam (yr 1-15; yr
2-19)
• Mixed methods questions pre workshop/
post exam
• Testimonials
• Consent was implied and without
incentive
6
Results
• Response rates for cohort 1-93%;
cohort 2-89%
Cohort 2
Cohort 1
Gen.
Peds
36%
Gen.
Peds
57%
Sub
Spec.
64%
Sub.
Spec.
43%
7
Results
Testimonials:
“the type of learning, knowledge, approaches and
resources acquired during this OSCE weekend were
far more beneficial than 50% of my educational half
days that I attended this year. I was able to use the
knowledge gained from the weekend as I
approached real patients in clinic as well as for my
exam. I truly believe that sessions made me a better
well rounded clinician”
8
Results
Testimonials:
“Regardless of the exam, after the OSCE project
weekend, I became a better clinician (as was noted
by my longitudinal clinic preceptor), especially when
it came to counseling (something we learn nothing
about during our 4 years of training).
The OSCE
weekend really taught me an approach to counseling
and all the elements needed to do it effectively and
efficiently.”
9
Results -
Perceptions of Preparedness
How prepared did you feel taking your Royal College
exams (2013-2014)
100
92
74
80
60
40
20
0
Not Prepared
50
47
40
29
13
0
0
21
Slightly Prepared
Prepared
Very Prepared
13 13
0
0 4
4
YEAR 1 PRE YEAR 1 POST YEAR 2 PRE YEAR 2 POST
10
Results –
Perceptions of Confidence
How confident do you feel upon taking your Royal
College exams (2013-2014)?
100
80
60
40
20
0
63
60
50
43
50
33
0
7
0
Slightly Confident
36
32
7
Not Confident
5
Confident
Very Confident
14
0
0
YEAR 1 PRE YEAR 1 POST YEAR 2 PRE YEAR 2 POST
11
Results –
Perceptions of Stress
Please indicate your stress level prior to taking
your Royal College Exams (2013-2014)?
100
73
80
71
Not Stressed
60
40
48
36
29
27
0 0
0 0
0
Slightly Stressed
Stressed
16
20
0
4343
14
Very Stressed
0
YEAR 1 PRE YEAR 1 POST YEAR 2 PRE YEAR 2 POST
12
Discussion/Conclusion
• Usefulness of workshop on the parameters of
preparedness, confidence and stress –
demonstrated
• Benefit in transition to independent practice –CBD
goal
• Valuable adjunct to formal OSCEs in formal curricula
• Limitations: small numbers and single center
• Future direction- survey past participants post
transition to practice re: utility of workshop
13
Acknowledgements
• Thank you to all participants
• Dept of Innovation in Medical Education
at the University of Ottawa for their
support of this study
• Dr. Noni MacDonald and Dr. Hilary Writer
14
Help us improve.
Your input matters.
Aidez-nous à nous améliorer.
Votre opinion compte!
• Download the ICRE App,
• Téléchargez l’application de la CIFR
• Visit the evaluation area in the Main
Lobby, near Registration, or
• Visitez la zone d’évaluation dans le hall
principal, près du comptoir d’inscription, ou
• Go to:
http://www.royalcollege.ca/icreevaluations to complete the
session evaluation.
• Visitez le
http://www.collegeroyal.ca/evaluationscifr afin de remplir une
évaluation de la séance.
You could be entered to win 1 of 3 $100 gift cards.
Vous courrez la chance de gagner l’un des trois chèques-cadeaux d’une valeur de 100.
15