Disparities Impacts Psychiatry Competency Assessments among Students in a Nigerian Medical School
Main Article Content
Keywords
Gender Disparities, Psychiatry Competency, Assessment, Formative, Summative , Evaluation , Medical Education.
Abstract
Background: Assessments in medical education must reliably evaluate competencies while addressing potential gender disparities. This study examines the reliability of psychiatry competency assessments among final-year medical students at the University of Ilorin, Nigeria, and explores gender differences in performance. The aim was to evaluate the internal consistency of formative (progressive assessment) and summative (final MBBS) examinations, analyse correlations between assessment components, and compare gender-based performance.
Methodology: A retrospective analysis of all 137 (77 male, 60 female) final year medical students’ psychiatry competence assessments was conducted. Reliability was measured using Cronbach’s alpha, correlations between exam components were assessed via Pearson’s correlation, and gender differences were analysed using t-tests and Cohen’s d.
Results: The combined assessments showed high reliability (α = 0.857), though lower for females (α = 0.553 vs. males: α = 0.618). Progressive assessment correlated moderately with theory components (Multiple Choice Questions: r = 0.507) but weakly with clinical tools (picture test: r = 0.158). Females outperformed males in both theory (mean difference: +1.71, p = 0.001) and clinical exams (mean difference: +1.08, p = 0.019), with moderate effect sizes (Cohen’s d = 0.63 and 0.42, respectively).
Conclusion: While the assessment system demonstrates strong overall reliability, gendered disparities suggest a need for more equitable evaluation methods. Females consistently outperformed males, but lower reliability in their combined scores calls for refined formative tools. Integrating more multimodal assessments may enhance fairness and validity.
References
2. Kordestani Moghaddam A, Khankeh HR, Shariati M, Norcini J, Jalili M. Educational impact of assessment on medical students’ learning at Tehran University of Medical Sciences: a qualitative study. BMJ Open. 2019;9(7):e031014.
3. Harden RM, Crosby JR. AMEE Guide No 20: The good teacher is more than a lecturer—the twelve roles of the teacher. Med Teach. 2000;22(4):334-47.
4. Fallatah HI, Tekian A, Park YS, Al Shawa L. The validity and reliability of the sixth-year internal medical examination administered at the King Abdulaziz University Medical College. BMC Med Educ. 2015;15:10.
5. Preston R, Gratani M, Owens K, Roche P, Zimanyi M, Malau-Aduli B. Exploring the impact of assessment on medical students’ learning. Assess Eval High Educ. 2019;45(1):109-24.
6. Safari M, Shahidi S, Avizhgan M. Challenges in applying theoretical knowledge from the general medicine course in clinical practice: a qualitative study. J Med Educ Dev. 2024;17(54):1-10.
7. Schildkamp K, van der Kleij FM, Heitink MC, Kippers WB, Veldkamp BP. Formative assessment: a systematic review of critical teacher prerequisites for classroom practice. Int J Educ Res. 2020;103:101602.
8. Ismail SM, Rahul DR, Patra I, Rezvani E. Formative vs. summative assessment: impacts on academic motivation, attitude toward learning, test anxiety, and self-regulation skill. Lang Test Asia. 2022;12(1).
9. Hawe E, Dixon H. Assessment for learning: a catalyst for student self-regulation. Assess Eval High Educ. 2017;42(8):1257-67.
10. Dolin J, Black P, Harlen W, Tiberghien A. Exploring Relations Between Formative and Summative Assessment. In: Dolin J, Evans R, editors. Transforming Assessment. Cham: Springer International Publishing; 2018. p. 53-80.
11. Bloom BS, Engelhart MD, Furst EJ, Hill WH, Krathwohl DR. Taxonomy of educational objectives: the classification of educational goals. Handbook I: Cognitive domain. New York: David McKay; 1956.
12. Anderson LW, Krathwohl DR. A taxonomy for learning, teaching, and assessing: a revision of Bloom’s taxonomy of educational objectives. New York: Longman; 2001.
13. Tuma F, Nassar AK. Applying Bloom’s taxonomy in clinical surgery: practical examples. Ann Med Surg (Lond). 2021;69:102656.
14. Riskiyana R, Qomariyah N, Hidayah RN, Claramita M. Towards improving soft skills of medical education in the 21st century: a literature review. Int J Eval Res Educ. 2022;11(4):2174-84.
15. Muntean LM, Nireștean A, Sima-Comaniciu A, Mărușteri M, Zăgan CA, Lukacs E. The relationship between personality, motivation and academic performance at medical students from Romania. Int J Environ Res Public Health. 2022;19(15):8993.
16. Al Mamun MMA, Alam KK, Talukder HK, Jahan S, Islam N, Chowdhury M. Medical students’ motivational factors and academic performance – undergraduate level of Bangladesh. Bangladesh J Med Educ. 2024;15(1):67-74.
17. Hayat AA, Salehi A, Kojuri J. Medical student's academic performance: The role of academic emotions and motivation. J Adv Med Educ Prof. 2018;6(4):168-75.
18. Henning MA, Krägeloh CU, Moir F, Webster CS. The relationship between coping strategies and student performance in medical education: a longitudinal study. Med Educ Online. 2015;20:27576.
19. Saxena S, Wright WS, Khalil MK. Gender differences in learning and study strategies impact medical students’ preclinical and USMLE step 1 examination performance. BMC Med Educ. 2024;24:504.
20. Li B, Jacob-Brassard J, Dossa F, Salata K, Kishibe T, Greco E, et al. Gender differences in faculty rank among academic physicians: a systematic review and meta-analysis. BMJ Open. 2021;11(11):e050322.
21. Kibuuka R, Mpasa F, Atuhairwe I, Agaba B, Nakattudde P, Owusu-Sekyere S, et al. Factors associated with retakes in health Professions Courses: A case study of Five selected Universities in Sub-Saharan Africa. Res Sq [Preprint]. 2024:rs.3.rs-5368416.
22. Blanch DC, Hall JA, Roter DL, Frankel RM. Medical student gender and issues of confidence. Patient Educ Couns. 2008;72(3):374-81.
23. Nguyen M, Zhao W, Olsen C. Gender differences in study strategies and performance among medical students: a LASSI-based study. BMC Med Educ. 2024;24:149.
24. Holmboe ES, Sherbino J, Long DM, Swing SR, Frank JR. The role of assessment in competency-based medical education. Med Teach. 2010;32(8):676-82.
25. Song X, Cleaves E, Gluzman E, Kotlyar B, Russo RA, Schilling DC, et al. A Scoping Review of Assessments in Undergraduate Medical Education: Implications for Residency Programs and Medical Schools. Acad Psychiatry. 2025;49(3):263-73.
26. Preston R, Gratani M, Owens K, Roche P, Zimanyi M, Malau-Aduli B. Exploring the Impact of Assessment on Medical Students’ Learning. Assess Eval High Educ. 2019;45(1):109-24.
27. The Council on Undergraduate Research. Assessment Tools [Internet]. 2024 [cited 2025 Jun 29]. Available from: https://www.cur.org/resources-publications/mentor-resources/assessment-tools/
28. Constantinou C, Wijnen-Meijer M. Student evaluations of teaching and the development of a comprehensive measure of teaching effectiveness for medical schools. BMC Med Educ. 2022;22(1):113.
29. LibGuides: Undergraduate Research: Studies on the Impact of Undergraduate Research on Students [Internet]. [cited 2025 Jun 29]. Available from: https://libguides.usu.edu/c.php?g=1066148&p=7820635
30. Kaifi R, Alshamrani K, Al-Nasser S, Omair A, Althaqafy M. The Relation Between Theoretical and Practical Exams for Health Sciences Students at King Saud Bin Abdulaziz University for Health Sciences- Jeddah. Adv Med Educ Pract. 2024;15:419-30.
31. Bhatti U, Chohan MN, Effendi S, Khidri FF, Ahmadani R, Ghaffar B. Gender-Based Variation in The Academic Performance of Medical Students: A Cross-Sectional Study. BioSight. 2023;4(2-3):45-50.
32. Novais F, Ganança L, Barbosa M, Telles-Correia D. Communication skills in psychiatry for undergraduate students: a scoping review. Front Psychiatry. 2022;13:972703.
33. Ross J, Watling C. Use of empathy in psychiatric practice: constructivist grounded theory study. BJPsych Open. 2017;3(1):26-33.
34. Fuller M, de Jong M, Kamans E, Wolfensberger M, van Vuuren M. Empathy competencies and behaviors in professional communication interactions: self versus client assessments. Bus Prof Commun Q. 2023;86(2):167-86.
35. Mohammed G, Bennett D. Effect of gender on medical students’ clinical learning experience in a multicultural setting. Adv Biomed Health Sci. 2023;2(3):131-8.
36. Samuriwo R, Patel Y, Webb K, Bullock A. ‘Man up’: medical students’ perceptions of gender and learning in clinical practice: a qualitative study. Med Educ. 2020;54(2):150-61.
37. Montolio D, Taberner PA. Gender differences under test pressure and their impact on academic performance: a quasi-experimental design. J Econ Behav Organ. 2021;191:1065-90.
38. Stanford University. Course feedback as a measure of teaching effectiveness [Internet]. 2015 [cited 2025 Jun 29]. Available from: https://evals.stanford.edu/evaluating-teaching/course-feedback-measure-teaching-effectiveness
39. Søndergaard MK, Degn L, Lassesen B. Thinking or talking about teaching? Student evaluation as an occasion for dialogue or reflection on teaching. Tert Educ Manag. 2024;30(2):147-63.
Article Sidebar
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.
This is an open-access journal and articles are distributed under the terms of the Creative Commons Attribution Non-Commercial Share-Alike License 4.0. This licence allows users to download and share, remix, tweak and build upon the article for non-commercial purposes, so long as the original authorship is acknowledged and the new creations are licensed under identical terms.