Acceptability and Feasibility of a Multiple Mini Interview for

Transcription

Acceptability and Feasibility of a Multiple Mini Interview
for Emergency Medicine Resident Selection
Author: Ian Walker, Margriet Greidanus, Todd Peterson, James Huffman
Date: Saturday, October 24, 2015
The International Conference on Residency Education
|
La Conférence internationale sur la formation des résidents
I do not have an affiliation (financial or otherwise)
with a pharmaceutical, medical device or
communications organization.
Je n’ai aucune affiliation (financière ou autre)
avec une entreprise pharmaceutique, un fabricant
d’appareils médicaux ou un cabinet de communication.
Author: James Huffman, FRCPC
Date: October 24, 2015
|
What is an
“MMI”?
|
What is known?
• It’s acceptable at undergrad level
• It’s reliable
• It’s predictive of clerkship and LMCC II scores
|
What is not as well known?
• Acceptability and performance in post grad
• Applicability to Emergency Residency selection
• Specific applicability in Canada
• Acceptability to assessors
• Predictive power
|
How acceptable is the MMI to our residency
applicants?
How acceptable is the MMI to our
assessors?
How reliable is the MMI in this context?
How does the MMI result compare to the
traditional interview result?
|
What we did
• 24 applicants
• Three traditional semi-structured 2 person panels
• 12 station MMI
• Survey’s post
• Rank ordering done using traditional method
• Rank ordering blinded to MMI results
|
Applicant Pool
• 24 applicants
• 19M, 5F
• 19 residents, 5 in practice
• 19 with prior MMI experience, 5 without
• 15 < 30 yrs old, 9 > 30 years old
|
Results – Applicant Surveys
|
Results – Assessor Surveys
|
Reliability was a Problem
• Crohnbach’s Alpha used as a measure of the
reliability (i.e. reproducibility) of the test.
• Perfect would be 1
• Acceptable would be 0.6
• Most MMI studies 0.6 to 0.75
• Ours = 0.238
|
There was no relationship
between the applicant ranks
using the two processes
R=0.126, p=NS
|
25
MMI Rank
20
15
10
5
0
0
5
10
15
20
Trad Rank
|
25
How acceptable is the MMI to our residency
applicants?
Moderately
How acceptable is the MMI to our assessors?
Very
How reliable is the MMI in this context?
Remains to be seen
How does the MMI result compare to the
traditional interview result?
Not at all
|
The Next Question
Which method is a better
predictor of actual performance
in the program?
|
25
MMI Rank
20
15
10
5
0
0
5
10
15
20
Trad Rank
|
25
Help us improve.
Aidons-nous à nous améliorer.
Your input matters.
Votre opinion compte.
• Download the ICRE App,
• Téléchargez l’application de la CIFR
• Visit the evaluation area
in the West Ballroom Foyer,
near Registration, or
• Visitez la zone d’évaluation, foyer
de la salle de bal Ouest, près du
comptoir d’inscription, ou
• Go to: http://www.royalcollege.ca/
icreevaluations to complete the
session evaluation.
• Visitez le http://www.collegeroyal
.ca/evaluationscifr afin de remplir
une évaluation de la séance.
You could be entered
to win 1 of 3
$100 gift cards.
|
Vous courrez la chance de gagner
l’un des trois chèques-cadeaux
d’une valeur de 100 $.

Acceptability and Feasibility of a Multiple Mini Interview for

Transcription

Documents pareils

Resident Research in the History of Medicine for the Uninitiated

CanNASC

What is stress?

Jeu de société sur l`histoire des sciences A board game on history of