|Year : 2020 | Volume
| Issue : 7 | Page : 3470-3473
An exploratory analysis of factors contributing to resident pass rates on a national licensure OSCE in the United Arab Emirates
Halah Ibrahim1, Thana Harhara1, Reima Al Marshoodi1, Ashraf Kamour1, Satish C Nair2
1 Department of Medicine, Sheikh Khalifa Medical City, Abu Dhabi, UAE
2 Department of Academic Affairs, Tawam Hospital Johns Hopkins Medicine, College of Medicine, UAE University, Al Ain, UAE
|Date of Submission||02-Mar-2020|
|Date of Decision||27-Mar-2020|
|Date of Acceptance||08-Apr-2020|
|Date of Web Publication||30-Jul-2020|
Dr. Satish C Nair
Department of Academic Affairs, Tawam Hospital- Johns Hopkins International, PO Box 15258, Al Ain
Source of Support: None, Conflict of Interest: None
Purpose: To explore resident perceptions of factors contributing to pass rates on a high-stake licensing objective structured clinical exam (OSCE). Materials and Methods: A cross-sectional survey was administered to all 51 applicants of the April 2019 internal medicine Arab Board OSCE examination in Abu Dhabi, United Arab Emirates (UAE), and included questions on preparedness, stress level, and prior educational experiences. Exposures were evaluated for correlation against Arab Board pass rates using Pearson correlation and the two-tailed significance was recorded. Results: All 51 examinees completed the survey (100% response rate). Participants were primarily female n = 35 (67%) and all completed residency training in the UAE. Gender differences were noted, with higher pass rates for the male residents (13/35, 37% females vs. 8/16, 50% males, P < 0.05). Further, 65% (P < 0.001) of female examinees reported higher levels of anxiety than male residents. Examinees reported regular exposure during residency to clinical skills training (74%), standardized patients (71%), simulation (66%), and OSCEs (72%) but none of these educational modalities correlated with higher pass rates. Of multiple exam preparation modalities, only self-directed learning with deliberate practice, the intentional repetition of a task with feedback, was associated with higher pass rates. Conclusion: Clinical exam skills are vital for trainees to deliver high-quality primary healthcare services. National licensure OSCEs have become the norm in the Arab world for assessing resident clinical exam skills. Our results suggest that residency programs should encourage residents' intentional deliberate practice and mastery learning in the acquisition and retention of physical examination techniques.
Keywords: Clinical skills, internal medicine, Objective Structured Clinical Examination, residents, self-directed learning
|How to cite this article:|
Ibrahim H, Harhara T, Al Marshoodi R, Kamour A, Nair SC. An exploratory analysis of factors contributing to resident pass rates on a national licensure OSCE in the United Arab Emirates. J Family Med Prim Care 2020;9:3470-3
|How to cite this URL:|
Ibrahim H, Harhara T, Al Marshoodi R, Kamour A, Nair SC. An exploratory analysis of factors contributing to resident pass rates on a national licensure OSCE in the United Arab Emirates. J Family Med Prim Care [serial online] 2020 [cited 2021 Apr 11];9:3470-3. Available from: https://www.jfmpc.com/text.asp?2020/9/7/3470/290792
| Background|| |
An accurate and complete history and physical exam forms the foundation for clinical reasoning and is critical for safe and effective patient care. Primary care has become an important element of medical education and clinical exam skills are vital for trainees to deliver high-quality primary healthcare services. Yet, studies show that medical students and residents have significant deficiencies in their clinical examination skills.,, How best to teach and assess these competencies has been a challenge for medical educators worldwide. The Objective Structured Clinical Exam (OSCE), since its introduction in 1975, has served as an important evaluation tool for assessing trainee clinical skills. A national licensure OSCE was implemented by Canada in 1992, and has since been replicated by countries worldwide. Within the past decade, many regulatory bodies in the Arab world, including the Arab Board of Medical Specialties and the Saudi Board, have adopted the OSCE as the final licensure examination.
Studies have highlighted the noncognitive factors that affect OSCE performance, including confidence, anxiety levels, and preparedness. The literature, however, has focused primarily on undergraduate students and in Western settings. As the OSCE has become a critical component of postgraduate licensure in the Arab world, it is important to understand the factors that influence resident performance during these clinical exams. This study is an exploratory analysis of factors that may contribute to improved pass rates on a high-stake OSCE for internal medicine residents.
| Materials and Methods|| |
The survey instrument was developed through a review of the medical literature identifying factors that have been shown to contribute to improved clinical skills,, and piloted on a cohort of recent graduates, who did not participate in the study. The instrument collected basic demographic information and included questions on preparedness, stress level, and prior educational experiences.
Participants and setting
The Arab Board accredits residency programs throughout the Arab world. Residents must pass a high-stake OSCE as a prerequisite to residency completion and licensure. The 6-station OSCE includes a communication and a history-taking station and 4 physical exam stations, each focusing on a single organ system. Examinees are observed and graded through a checklist for a predetermined set of standardized observable techniques. In April 2019, the Arab Boards OSCE was delivered in Abu Dhabi, a hub for the country's residency programs and capital of the United Arab Emirates (UAE), to a cohort of general internal medicine residents. Using convenience sampling methodology, we conducted a cross-sectional survey of all applicants to the April 2019 internal medicine Arab Board OSCE. A written, self-administered survey was distributed and collected before the OSCE by a volunteer not involved in the exam process. Participation was anonymous and voluntary, and residents were informed that survey completion did not affect test scores. Examinees were assigned a unique identifier to match survey responses with examination scores.
The collected data was analyzed using the Statistical Package for Social Sciences, IBM, Chicago, IL, version 21 for descriptive statistics. Various exposures were evaluated for correlation against the Arab board pass rates using Pearson Correlation and two-tailed significance recorded. A value of P < 0.05 was considered to be significant. The manuscript adheres to STROBE guidelines for reporting observational research. The study was reviewed and approved by the Sheikh Khalifa Medical City Research Ethics Committee (RS-573).
| Results|| |
All 51 examinees signed written consents and completed the survey (100% response rate). Demographic characteristics of the residents are shown in [Table 1]. The majority of examinees reported regular exposure during residency to clinical skills training (40/51, 74%), standardized patients (37/51, 71%), simulation (34/51, 66%), and mock OSCEs (37/51, 72%); none of these educational modalities correlated with higher pass rates [Table 2]. The residents used several different preparation modalities. Only deliberate practice, defined as the mindful and intentional repetition of practicing physical exam skills with patients, 4 correlated with higher pass rates with 63% (P < 0.001) of those who passed reporting this as their primary study technique [Table 3]. Gender differences were noted, with higher pass rates for the male residents, using the Chi-square test (13/35, 37% females vs. 8/16, 50% males, P < 0.05). Further, 71% (25/35, P < 0.05) of female examinees reported higher levels of anxiety than male residents (44%, 7/16, P < 0.05) and higher anxiety correlated with higher pass rates (30/51, 59%, P < 0.05).
|Table 3: Correlation Between Methods of Exam Preparation and OSCE Pass Rate (n=51)|
Click here to view
| Discussion|| |
Given the time and financial investment involved in training future physicians, optimizing licensure exam pass rates does not just affect the individual trainee, but has implications for education and healthcare systems worldwide. Further, as general internists provide primary healthcare services to the community, it is incumbent upon training programs to ensure that graduates are proficient in their clinical examination skills. In recent years, residency programs have included, at great manpower and financial expenditure, additional educational initiatives to improve resident clinical skills, including high-fidelity simulation, computer technologies, and standardized patients. Our results did not show a correlation between these modalities and improved OSCE pass rates. It has long been acknowledged that teaching clinical skills is time-intensive and is directly correlated to the amount of time trainees spent performing clinical exam techniques with their senior clinicians. Although these technologies may be useful adjuncts to provide trainees with opportunities to practice and refine their physical exam techniques, our study suggests that they should not replace direct patient contact with observation and feedback from faculty.
It has been suggested that the unfamiliarity of the OSCE format may contribute to increased test anxiety. In our study, 72% of examinees had prior exposure to OSCEs during training, but these experiences did not translate into higher pass rates, even for those who participated in multiple OSCEs. Residents also reported several test preparation modalities; only deliberate practice, repetitive and mindful practice of physical examination techniques with patients, was associated with higher pass rates. Studies have shown that trainee retention of clinical skills is enhanced when they are allowed self-guided access to instructional material and set process goals. Further, there is a large body of literature showing that mastery learning with deliberate practice is correlated with improved physician procedural skills and better patient outcomes. Our data confirm the importance of deliberate practice and self-directed learning in physical examination skills attainment.
The gender differences in OSCE pass rates for our examinees varies from other studies, which found that female trainees generally score higher on standardized patient examinations and clinical skills tests., Further studies are necessary to assess if these gender differences persist in larger scale or multinational studies or if gender biases contributed to these results. Our findings are consistent with other research that has shown higher test anxiety rates for female trainees. It is notable that in this group of residents, higher anxiety correlated with higher pass rates. The literature is inconclusive on whether stress interferes with learning and leads to poor performance during assessments, or whether a high level of test anxiety is functional, perhaps leading to increased arousal and better scores.,
Limitations of this study include the small sample size and single specialty, which limits generalizability. The cross-sectional design can only determine correlation, not causality. Also, inherent to any self-report of complex issues, such as examination performance, are influencing factors that may not have been fully addressed, including trainee personality and previous examination performance. Nonetheless, this study offers important considerations for both trainees and educational program leaders.
| Conclusions|| |
A main objective of any training program is to graduate doctors who are competent in clinical examination skills. This holds especially true for primary care programs. As national licensure OSCEs have become the norm in the Arab world, our results suggest that residency programs should continue to encourage residents' deliberate practice and self- directed learning in the acquisition and retention of physical examination techniques.
List of Abbreviations
OSCE: Objective Structured Clinical Examination.
Ethics approval and consent to participate
The study was approved by the Sheikh Khalifa Medical City Research Ethics Committee (RS-573). All participants signed written consent prior to survey completion.
The authors declare that they have no competing interests.
Financial support and sponsorship
The authors have not received any funding for this study.
Conflicts of interest
There are no conflicts of interest.
| References|| |
Haring CM, Cools BM, van der Meer JW, Postma CT. Student performance of the general physical examination in internal medicine: An observational study. BMC Med Educ 2014;14:73.
Rousseau M, Konings KD, Touchie C. Overcoming the barriers of teaching physical examination at the bedside: More than just curriculum design. BMC Med Educ 2018;18:302.
Crumlish CM, Yialamas MA, McMahon GT. Quantification of bedside teaching by an academic hospitalist group. J Hosp Med 2009;4:304-7.
Harden RM, Stevenson M, Downie WW, Wilson GM. Assessment of clinical competence using objective structured examination. Br Med J 1975;1:447-51.
Reznick RK, Blackmore D, Dauphinee WD, Rothman AI, Smee S. Large-scale high-stakes testing with an OSCE: Report from the Medical Council of Canada. Acad Med 1996;71 (1 Suppl):S19-21.
Hijazi M, Downing SM. Objective structured clinical examinations as an assessment method in residency training: Practical considerations. Ann Saudi Med 2008;28:192-9.
] [Full text]
Longyhore DS. Pharmacy student anxiety and success with Objective Structured Clinical Examinations. Am J Pharm Educ 2017;81:7.
Uchida T, Achike FI, Blood AD, Boyle M, Farnan JM, Gowda D, et al
. Resources used to teach the physical exam to preclerkship medical students: Results of a national survey. Acad Med 2018;93:736-41.
Johnson J, Carpenter JL. Medical house staff performance in physical examination. Arch Intern Med 1986;146:937-41.
Association of American Medical Colleges. The AAMC Project on the clinical education of medical students: Clinical skills education. Washington, DC: AAMC; 2005.
Mookherjee S, Pheatt L, Ranji SR, Chou CL. Physical examination education in graduate medical education--a systematic review of the literature. J Gen Intern Med 2013;28:1090-9.
McGaghie WC. Mastery learning: It is time for medical education to join the 21st
century. Acad Med 2015;90:1438-41.
Graf J, Smolka R, Simoes E, Zipfel S, Junne F, Holderried F, et al
. Communication skills of medical students during the OSCE: Gender-specific differences in a longitudinal trend study. BMC Med Educ 2017;17:75.
Berg K, Blatt B, Lopreiato J, Jung J, Schaeffer A, Heil D, et al
. Standardized patient assessment of medical student empathy: Ethnicity and gender effects in a multi-institutional study. Acad Med 2015;90:105-11.
Harris RB, Grunspan DZ, Pelch MA, Fernandes G, Ramirez G, Freeman S. Can test anxiety interventions alleviate a gender gap in an undergraduate STEM course? CBE Life Sci Educ 2019;18:ar35.
Kim KJ. Factors associated with medical student test anxiety in objective structured clinical examinations: A preliminary study. Int J Med Educ 2016;7:424-7.
Hadi MA, Ali M, Haseeb A, Mohamed MMA, Elrggal ME, Cheema E. Impact of test anxiety on pharmacy students' performance in Objective Structured Clinical Examination: A cross-sectional survey. Int J Pharm Pract 2018;26:191-4.
[Table 1], [Table 2], [Table 3]