Toelating van geneeskundestudenten

Ontwikkeling en toepassing van een situationele beoordelingstest voor het meten van integriteit
02/07/2021
Wendy de Leng
Geen reacties
Erce_shutterstock_330872621
Volume 56, Issue 7

Samenvatting

Judging medical students

W. De Leng

This paper describes a PhD thesis examining the development and use of a Situational Judgement Test (SJT) for selecting medical students based on the noncognitive attribute of integrity. An SJT consists of scenarios that describe dilemma-like situations in a relevant context (e.g. medical school) followed by possible reactions to those situations. The task of the candidate is to judge the appropriateness of those response options. The fi ve studies of the thesis investigate how several test characteristics infl uence a number of quality criteria of an SJT in measuring integrity among medical school applicants. The test characteristics under study are the development method, response format, scoring method, response appropriateness and response instructions. The quality criteria under examination are reliability, construct validity, criterion-related validity, subgroup differences, fakability and applicant perceptions. The study outcomes are described in this paper and may contribute to the development and use of integrity-based SJTs for medical school admissions.

792 Weergaven
6 Downloads
  • Samenvatting
  • Introductie
  • Ontwikkeling
  • Scoring
  • Verdraaiing
  • Kandidaat reacties
  • Voorspellende waarde
  • Conclusie en aanbevelingen
  • Literatuurlijst
  • Over de auteur
Log in
Veel opleidingen beschouwen niet-cognitieve eigenschappen als relevant voor de studie en het toekomstige werkveld van studenten. Denk aan goede communicatieve vaardigheden, empathisch vermogen en een professionele houding. Die aandacht voor de niet-cognitieve component is ook steeds vaker terug te zien in de selectieprocedures van geneeskundeopleidingen. Wendy de Leng deed onderzoek naar de geschiktheid van een situationele beoordelingstest in dat selectieproces.

Introductie

Sinds de invoering van de wet Kwaliteit in Verscheidenheid mochten opleidingen met een numerus fixus hun studenten niet meer toelaten op basis van loting, maar alleen door middel van selectie. Hierdoor staan de toelatingscommissies van deze opleidingen voor de taak om hun selectieprocedures zo in te richten dat de juiste student op de juiste plek terechtkomt. Het afgelopen decennium zijn in Nederland diverse (promotie)onderzoeken uitgevoerd naar methoden voor het selecteren van studenten (De Visser, 2018; Lucieer, 2016; Niessen, 2018; Schreurs, 2020; Schripsema, 2017; Urlings- Strop, 2018; Wouters, 2017).

Eén aanpak is om de selectieprocedure te richten op een verscheidenheid aan eigenschappen die relevant zijn voor de betreffende opleiding. De selectie van studenten voor toelating tot het hoger onderwijs richt zich veelal op cognitieve eigenschappen, zoals intelligentie en studievaardigheden. Methoden voor het meten van deze eigenschappen zijn vaak gemakkelijk voorhanden (

Literatuurlijst

  1. Barriga, A.Q. & Gibbs, J.C. (1996). Measuring cognitive distortion in antisocial youth: Development and preliminary validation of the “How I Think” questionnaire. Aggressive Behavior, 22, 333-343.
  2. Bergman, M.E., Drasgow, F., Donovan, M.A., Henning, J.B. & Juraska, S.E. (2006). Scoring situational judgment tests: Once you get the data, your troubles begin. International Journal of Selection and Assessment, 14, 223-235.
  3. Catano, V.M., Brochu, A. & Lamerson, C.D. (2012). Assessing the reliability of situational judgment tests used in high-stakes situations. International Journal of Selection and Assessment, 20, 333-346.
  4. Chan, D. & Schmitt, N. (2005). Situational Judgment Tests. In A. Evers, N. Anderson, & O. Voskuijl (Reds.), The Blackwell Handbook of Personnel Selection (pp. 219-242). Malden, Verenigde Staten: Blackwell Publishing.
  5. Chan, D., Schmitt, N., DeShon, R.P., Clause, C.S. & Delbridge, K. (1997). Reactions to cognitive ability tests: The relationships between race, test performance, face validity perceptions, and test-taking motivation. Journal of Applied Psychology, 82, 300-310.
  6. Christian, M.S., Edwards, B.D. & Bradley, J.C. (2010). Situational judgment tests: Constructs assessed and a meta-analysis of their criterionrelated validities. Personnel Psychology, 63, 83-117. Cook, M. (2016). Personnel selection: Adding value through people – A changing picture. Malden, Verenigde Staten: John Wiley & Sons Ltd.
  7. De Leng, W. (2019). Measuring integrity for selection into medical school. Development of a Situational Judgement Test. Academisch proefschrift, Erasmus Universiteit Rotterdam.
  8. De Visser, M. (2018). Curriculum sample selection for entry to medical school (Disseratie). Geraadpleegd van: http://hdl.handle.net/2066/195514
  9. De Vries, R.E. & Born, M.P. (2013). De Vereenvoudigde HEXACO Persoonlijkheidsvragenlijst en een additioneel interstitieel Proactiviteitsfacet. Gedrag & Organisatie, 26, 223-245.
  10. Duffy, T.P. (2011). The Flexner report – 100 years later. Yale Journal of Biology and Medicine, 84, 269-276.
  11. Flanagan, J.C. (1954). The critical incident technique. Psychological Bulletin, 51, 327-358.
  12. Frank, J.R., Snell, L. & Sherbino, J. (2015). CanMEDS 2015 Physician competency framework. Ottawa, Canada: The Royal College of Physicians and Surgeons of Canada.
  13. Lee, K., Ashton, M.C., Morrison, D.L., Cordery, J. & Dunlop, P.D. (2008). Predicting integrity with the HEXACO personality model: Use of self and observer reports. Journal of Occupational and Organizational Psychology, 81, 147-167.
  14. Lievens, F. (2013). Adjusting medical school admission: Assessing interpersonal skills using situational judgement tests. Medical Education, 47, 182-189.
  15. Lievens, F., Patterson, F., Corstjens, J., Martin, S. & Nicholson, S. (2016). Widening access in selection using situational judgement tests: Evidence from the UKCAT. Medical Education, 50, 624-636.
  16. Lievens, F., Sackett, P.R. & Buyse, T. (2009). The effects of response instructions on situational judgment test performance and validity in a high-stakes context. Journal of Applied Psychology, 97, 1095-1101. Lucieer, S.M. (2016). Selecting students for medical education: Exploring novel approaches (Dissertatie). Geraadpleegd van https://repub.eur.nl/ pub/79232/160108_Lucieer-Susanna-Magdalena.pdf
  17. Luschin-Ebengreuth, M., Dimai, H. P., Ithaler, D., Neges, H.M. & Reibnegger, G. (2015). Situational judgment test as an additional tool in a medical admission test: An observational investigation. BMC Research Notes, 8, 81.
  18. McDaniel, M.A., Psotka, J., Legree, P.J., Yost, A.P. & Weekley, J.A. (2011). Toward an understanding of situational judgment item validity and group differences. Journal of Applied Psychology, 96, 327-336.
  19. Mercaldo, N.D., Lau, K.F. & Zhou, X. H. (2007). Confi dence intervals for predictive values with an emphasis to case-control studies. Statistics in Medicine, 26, 2170-2183.
  20. Nguyen, N.T., Biderman, M.D. & McDaniel, M. A. (2005). Effects of response instructions on faking a situational judgment test. International Journal of Selection and Assessment, 13, 250-260.
  21. Niessen, A.S.M. (2018). New rules, new tools: Predicting academic achievement in college admissions (Dissertatie). Geraadpleegd van http://hdl. handle.net/11370/57c4d08f-7ca2-4348-8aa1-69f09a499005
  22. Patterson, F., Ferguson, E. & Thomas, S. (2008). Using job analysis to identify core and specifi c competencies: Implications for selection and recruitment. Medical Education, 42, 1195-1204.
  23. Robins, R.W., Fraley, R.C., Roberts, B.W. & Trzesniewski, K.H. (2001). A longitudinal study of personality change in young adulthood. Journal of Personality, 69, 617-640.
  24. Schmidt, F.L., Oh, I. & Shaffer, J.A. (2016). The validity and utility of selection methods in personnel psychology: Practical and theoretical implications of 100 years of research fi ndings. Geraadpleegd van http://home.ubalt.edu/tmitch/645/session%204/Schmidt%20&%20Oh%20MKUP%20 validity%20and%20util%20100%20yrs%20of%20research%20Wk%20 PPR%202016.pdf
  25. Schmitt, N. & Chan, D. (1999). The status of research on applicant reactions to selection tests and its implications for managers. International Journal of Management Reviews, 1, 45-62.
  26. Schreurs, S. (2020). Selection for medical school: The quest for validity (Dissertatie). Geraadpleegd van https://cris.maastrichtuniversity.nl/en/ publications/selection-for-medical-school-the-quest-for-validity
  27. Schripsema, N.R. (2017). Medical student selection: Effects of different admissions processes (Dissertatie). Geraadpleegd van http://hdl.handle. net/11370/d1c85157-2d48-4f54-ae46-6f598b73e4f2
  28. Siu, E. & Reiter, H.I. (2009). Overview: What’s worked and what hasn’t as a guide towards predictive admissions tool development. Advances in Health Sciences Education, 14, 759-775.
  29. Stemler, S.E., Aggarwal, V. & Nithyanand, S. (2016). Knowing what NOT to do is a critical job skill: Evidence from 10 different scoring methods. International Journal of Selection and Assessment, 24, 229-245.
  30. Uggerslev, K.L., Fassina, N.E. & Kraichy, D. (2012). Recruiting through the stages: A meta-analytic test of predictors of applicant attraction at different stages of the recruiting process. Personnel Psychology, 65, 597-660.
  31. Urlings-Strop, L. (2018). Developing a tool for selection for medical school: A search for academic and non-academic parameters to predict future medical school performance (Dissertatie). Geraadpleegd van https://repub.eur. nl/pub/109919/
  32. Van Hooft, E.A.J. & Born, M.P. (2012). Intentional response distortion on personality tests: Using eye-tracking to understand response processes when faking. Journal of Applied Psychology, 97, 301-316.
  33. Verhagen, L. (2020). De sollicitatierobot moet kandidaten eerlijker beoordelen dan mensen. Lukt dat al? De Volkskrant. Geraadpleegd van https://www.volkskrant.nl/wetenschap/de-sollicitatierobot-moetkandidaten- eerlijker-beoordelen-dan-mensen-lukt-dat-al~be737994/
  34. Weekley, J.A. & Ployhart, R.E. (2006). Situational judgment tests: Theory, measurement, and application. Mahwah, Verenigde Staten: Lawrence Erlbaum Associates, Inc.
  35. Witten, I.H., Frank, E. & Hall, M.A. (2011). Data mining: Practical machine learning tools and techniques. San Francisco, Verenigde Staten: Morgan Kaufmann.
  36. Wouters, A. (2017). Effects of medical school selection: On the motivation of the student population and applicant pool (Dissertatie). Geraadpleegd van https://research.vu.nl/en/publications/effects-of-medical-schoolselection-on-the-motivation-of-the-stud