Impact of the final adjective in the Medical Student Performance Evaluation on determination of applicant desirability

Mark A. Ward, Debra L. Palazzi, Martin I. Lorin, Anoop Agrawal, Hilel Frankenthal, Teri L. Turner

Research output: Contribution to journalArticlepeer-review

8 Scopus citations

Abstract

Background: The Medical Student Performance Evaluation (MSPE) is a primary source of information used by residency programs in their selection of trainees. The MSPE contains a narrative description of the applicant’s performance during medical school. In 2002, the Association of American Medical Colleges’ guideline for preparation of the MSPE recommended inclusion of a comparative summative assessment of the student’s overall performance relative to his/her peers (final adjective). Objective: We hypothesize that the inclusion of a final adjective in the MSPE affects a reviewer’s assessment of the applicant’s desirability more than the narrative description of performance and designed a study to evaluate this hypothesis. Design: Fifty-six faculty members from the Departments of Pediatrics and Medicine with experience reviewing MSPEs as part of the intern selection process reviewed two pairs of mock MSPE letters. In each pair, the narrative in one letter was superior to that in the other. Two final adjectives describing relative class ranks were created. Each subject was first presented with a pair of letters with mismatched final adjective (study), i.e., the letter with the stronger narrative was presented with the weaker final adjective and vice versa. The subject was then presented with a second pair of letters without final adjectives (control). Subjects ranked the relative desirability of the two applicants in each pair. Results: The proportion of rankings congruent with the strength of the narratives under study and control conditions were compared. Subjects were significantly less likely to rank the applicants congruent with the strength of the narratives when the strength of the final adjectives conflicted with the strength of the narrative; 42.9% of study letters were ranked congruent with the narrative versus 82.1% of controls (p = 0.0001). Conclusion: The MSPE final adjective had a greater impact than the narrative description of performance on the determination of applicant desirability. Abbreviations: MSPE: Medical Student Performance Evaluation; AAMC: Association of American Medical Colleges; BCM: Baylor College of Medicine.

Original languageEnglish
Article number1542922
JournalMedical Education Online
Volume23
Issue number1
DOIs
StatePublished - Dec 2018
Externally publishedYes

Bibliographical note

Publisher Copyright:
© 2018, © 2018 The Author(s). Published by Informa UK Limited, trading as Taylor & Francis Group.

Keywords

  • dean’s letter
  • intern selection
  • medical student
  • Medical Student Performance Evaluation
  • residency applicants

Fingerprint

Dive into the research topics of 'Impact of the final adjective in the Medical Student Performance Evaluation on determination of applicant desirability'. Together they form a unique fingerprint.

Cite this