A correlation between pretest and posttest scores for a formative assessment and modified essay question (MEQ) scores for a summative assessment among fifth-year medical students in the gastrointestinal emergency session

Authors

  • Ar-aishah Dadeh Department of Emergency Medicine, Faculty of Medicine, Prince of Songkla University
  • Paramat Siriyod Department of Emergency Medicine, Faculty of Medicine, Prince of Songkla University
  • Jirawat Khongsin Department of Emergency Medicine, Faculty of Medicine, Prince of Songkla University

Keywords:

Pretest, Posttest, Formative assessment, Summative assessment, Modified essay question

Abstract

Abstract

Formative testing is used to track and evaluate a (learning) program that is still being implemented. As a result, formative testing can aid intrinsic motivation. Summative assessments are used to examine the competencies of the students, evaluate a previously completed (learning) program, and to qualify them for more advanced educational segments. Multiple-choice questions (MCQs) have a greater ability to test knowledge and factual recall. On the other hand, the modified essay questions (MEQ) aim to assess the problem-solving and the clinical reasoning skills of the students. The present study aims to evaluate the correlation between the pretest and posttest scores for a formative assessment and MEQ score for a summative assessment among fifth-year medical students. This was a retrospective observational study by fifth-year medical students in the gastrointestinal emergency session in the subject of the emergency and trauma in the 2021 academic year.  The correlation between the pre-and-posttest scores and the MEQ score was calculated using the correlation coefficient and paired t-test. A total of 100 medical students were enrolled in this study, with 46% males and 54% females. The median of pretest score, posttest score, and mean of MEQ score were six (IQR 5-7), and 10 (IQR 9.8-10), and 70.6 + 9.9 points, respectively. The students were divided into two groups, including students who had a minimum passing level and an MEQ score of greater than or equal to 60 points and had a cumulative grade point average of 3.2 + 0.32, which was higher than those who failed to pass the MPL and with a cumulative grade point average of 2.9 + 0.47. The pretest and posttest scores had a very low correlation with the final MEQ score, with an r value of 0.119 and 0.029, respectively. In conclusion, formative assessment using MCQs had a very low correlation with a final MEQ score for summative assessment. On the other hand, the students who passed the MPL score on the final MEQ had a higher cumulative grade point average than the students who failed to pass the MPL, which was also statistically significant.

Downloads

Download data is not yet available.

References

Maier U. Vergleichsarbeiten im Spannungsfeld zwischen formativer und summativer Leistungsmessung. Dtsch Schule 2010;102:60-9.

Ben-David MF. The role of assessment in expanding professional horizons. Med Teach 2000;22:472-7.

Cilliers FJ, Schuwirth LW, Adendorff HJ, et al. The mechanism of impact of summative assessment on medical students' learning. Adv Health Sci Educ Theory Pract 2010;15:695-715.

Khan MU, Aljarallah BM. Evaluation of modified essay questions (MEQ) and multiple choice questions (MCQ) as a tool for assessing the cognitive skills of undergraduate medical students. Int J Health Sci (Qassim) 2011;5:39-43.

Feletti GI, Engel CE. The modified essay question for testing problem-solving skills. Med J Aust 1980;1:79-80.

Katanyoo K, Amornchaicharensook Y, Soorapanth C. Association between outcomes of Sixth-year Medical students’ self-assessments of modified essay question examination compared with outcomes of modified essay question examination: Faculty of Medicine Vajira hospital, Navamindradhiraj university. Vajira Med J 2016;60:23-32.

Laisnitsarekul B, Tantayaporn K, Kiattinart S. The correlation between GPAX and comprehensive MCQ score of the medical students academic year 1995-1999, Faculty of Medicine, Chulalongkorn University. Chula Med J 2001;45:971-80.

Gay LR. Educational evaluation and measurement: competencies for analysis and application. 2nd ed. New York: Macmilla; 1991. p.374.

Büssing O, Ehlers JP, Zupanic M. The prognostic validity of the formative for the summative MEQ (Modified Essay Questions). GMS J Med Educ 2021;38:Doc99.

Black P, Wiliam D. Developing the theory of formative assessment. Educ Asse Eval Acc 2009;21:5.

Mondal H, Mondal S. Trait emotional intelligence and self assessment of classroom learning in medical students. J Adv Med Educ Prof 2020;8:109 14.

Labarca J, Figueroa C, Huidobro B, et al. Perception of medical students about formative assessments during clinical courses. Rev Med Chile 2014;142:1193-9.

Mondal H, Sahoo MR, Samantaray R, et al Medical students' perception on the usefulness of online formative assessment: A single-center, mixed-method, pilot study. J Edu Health Promot 2021; 10:243.

Palmer EJ, Devitt PG. Assessment of higher order cognitive skills in undergraduate education: modified essay or multiple choice questions? Research paper. BMC Med Educ 2007;7:49.

Downloads

Published

2022-12-29

Issue

Section

Short Communication (บทความวิจัยอย่างสั้น)