IMR Press / CEOG / Volume 48 / Issue 5 / DOI: 10.31083/j.ceog4805168
Open Access Original Research
Can ACGME Milestones predict surgical specialty board passage: an example in Obstetrics and Gynecology
Show Less
1 Department of Obstetrics and Gynecology, University of Cincinnati, Cincinnati, OH 45267, USA
2 Department of Maternal-Fetal Medicine, University of New Mexico School of Medicine, Albuquerque, NM 87131, USA
3 Department of Obstetrics and Gynecology, Emory University, Atlanta, GA 30322, USA
4 Department of Obstetrics and Gynecology, Beaumont, Royal Oak, MI 48073, USA
5 Department of Computer Sciences, Wayne State University, Detroit, MI 48201, USA
6 Department of Obstetrics and Gynecology, St. Vincent’s Catholic Medical Centers, New York, NY 10011, USA
7 Department of Obstetrics and Gynecology, Wayne State University, Detroit, MI 48201, USA
8 Department of Obstetrics and Gynecology and NIH-Women’s Reproductive Health Research Scholar, Wayne State University, Detroit, MI 48201, USA
*Correspondence: marecanati@wayne.edu (Maurice-Andre Recanati)
§Current or former program director or chair.
Clin. Exp. Obstet. Gynecol. 2021, 48(5), 1048–1055; https://doi.org/10.31083/j.ceog4805168
Submitted: 23 May 2021 | Revised: 13 July 2021 | Accepted: 20 July 2021 | Published: 15 October 2021
Copyright: © 2021 The Author(s). Published by IMR Press.
This is an open access article under the CC BY 4.0 license (https://creativecommons.org/licenses/by/4.0/).
Abstract

Background: Multiple tools including Accreditation Council for Graduate Medical Education (ACGME) standardized milestones can be utilized to assess trainee and residency program performance. However, little is known regarding the objective validation of these tools in predicting written board passage. Methods: In this retrospective study, data was gathered on n = 45 Wayne State University Obstetrics and Gynecology program graduates over the five-year period ending July 2018. United States Medical Licensing Examination (USMLE) scores, Council on Resident Education in Obstetrics and Gynecology (CREOG) in-training scores and ACGME milestones were used to predict American Board of Obstetrics and Gynecology (ABOG) board passage success on first attempt. Significance was set at p < 0.05. Results: Written board passage was associated with average CREOGs (p = 0.01) and milestones (p = 0.008) while USMLE1 was not significantly associated (p = 0.055). USMLE1 <217 (Positive predictive value (PPV) = 96%). CREOGs <197 (PPV = 100%) and milestones <3.25 (PPV = 100%), particularly practice-based learning and systems-based practice milestones were most strongly correlated with board failure. Using a combination of these two milestones, it is possible to correctly predict board passage using our model (PPV = 86%). Discussion: This study is the first validating the utility of milestones in a surgical specialty by demonstrating their ability to predict board passage. Residents with CREOGs or milestones below thresholds are at risk for board failure and may warrant early intervention.

Keywords
CREOG
ABOG
Board passage
Milestones
USMLE
Funding
K-12HD001254/NIH-Women’s Reproductive Health Research Career Development Award to MAR
Figures
Fig. 1.
Share
Back to top