BACKGROUND: The objective of this study was to investigate whether previous experiences within an anesthesiology-based Objective Structured Clinical Examination (OSCE) assessing communication and professionalism skills was associated with improved performance in a subsequent anesthesiology-based OSCE scenario. METHODS: This retrospective multi-center study used the performance data of 44 Post Graduate Year 4 clinical anesthesia residents from 3 US anesthesiology residency programs on an OSCE scenario that assessed the residents' effectiveness of discussing anesthesiology-specific treatment options with a high-risk patient. Residents from 2 of the programs had no prior anesthesiology-based OSCE experience. Residents from the third program had previously participated in 4 separate multi-scenario anesthesiology-based OSCE sessions in the 2 years prior to this study. Participating residents completed the same scenario at their respective institutions' simulation center. Ten performances were randomly selected for double rating to assess the interrater reliability of the assessments. Interrater reliability was good for the scenario (intraclass correlation coefficient = 0.66, 95% confidence interval = 0.12-0.90). Performance difference between groups with different OSCE experience status were examined using an independent sample t test, with a Wilcoxon-Mann-Whitney test as a sensitivity analysis. RESULTS: Independent sample t test found prior OSCE experience was significantly associated with higher performance scores (t = 2.53, P = .02). The Wilcoxon-Mann-Whitney test result confirmed this finding (z = 3.28, P = .001). CONCLUSIONS: Findings from this study provide preliminary evidence that anesthesiology-based OSCE experience is associated with improved performance in an OSCE scenario, specifically regarding discussions of treatment options with high-risk patients.
