Analytic assessment of multiple-choice tests

Maryamsadat kaveh tabatabaee, Mohammad Hossein Bahreyni Toosi, Akbar Derakhshan, Mohammad Khajeh Dalloee, Hassan Gholami

Abstract


280

Background: Multiple  choice tests (MCT),are widely known and  applied as useful evaluation tests in the field of education  especially  in Medical  Science.  Items on a multiple-choice test consist of a stem, which is followed by a correct answer as well as three to jour distracters. Items on a well-written multiple-choice test will have stems that are precise and clear, one answer that is clearly correct or best, and distracters that are plausible.

Purpose: The purpose of the present study is conducting item and test analysis to 24 MCTs given in first semester of 2000-2001 educational year in medical faculty of Mashad University of Medical Science.

Methods: Data of this descriptive study were composed of 1496 MCQs gathered from  2092 answer sheets of 24 MCTs obtained from educational department of the medical faculty.A split-half method of reliability was employed to calculate reliability coefficient for MCTs. Items Difficulty and Discrimination index also were calculated for questions. Further studies should be undertaken for developments the methods for evaluation of validity, assessment of distracters and structural principles in MCTs .

Results: Mean reliability coefficient of the exams was 0.72±0.13 and In more than 50% of cases, reliability coefficient was greater than 0.7. There was a significant difference between basic science exams and clinical clerkship exams in Reliability coefficient (P=0.001). Mean standard error a/measurement (SEM) was 3.51±1.11. In  52.2%  of the cases, difficulty of MCQs was inappropriate and 49.3% of questions had inadequate discriminative power to discern between poor students and good students.

Conclusion: Our finding indicate that only 33% of studied MCQs have desirable or acceptable item difficulty and discrimination indices both and 34.9% of those have no desirable or acceptable item difficulty neither acceptable discrimination index. Having subjects respond reliably on a measure is a great sta11, but there is another  concept

needed to gel down really well named validity.

 Keywords: multiple choice question, test analysis, reliability, item difficulty Discrimination index


Keywords


multiple choice question, test analysis, reliability, item difficulty Discrimination index

Full Text:

PDF

160

References


l. SeyfAA. Measurement and assessment tools in education. Daavaran publ, Tehran, Iran, 1999[Farsi].

Gilbert JJ. Instruction for training of the primary health care providers.] st ed. Tehran: academic publication center,1985.[Farsi translation by Arfaa F

Amini Nik S, Azoudi P, Djahanpour F. Study of methods implied by faculty members of Bousher Unversity of Medical Science for assessing students' academic achievement. Bulletin of congress of medical education 2000:l3-14[Farsi].

Arab M, Assessment of multiple choice questions in Hamedaan Medical University during second semester of 1999-2000 educational year. Bulletin of 41 congress of medical education 2000:51[Farsi]

Yuosefi Mashoof R. Study of current methods used for evaluating knowledge and practice of the medical students. Bulletin of achievements during [Dissertation]. Mashad Medical Science 2001. clinic clerkship Unversity of 4th congress of medical education 2000:74- 75 [Farsi].

Mavis BE, Cole BL, Hoppe RB, A survey of students assessment in U.S medical schools: The balance of Breath versus fidelity. Teaching and Learning m Medicine 2001;13(2):74-79.

Tabatabaee MSK,Toosi MHB, Modaber MD, Ebrabimzadeh S, Toosi VB, toosi KB.Study of students, attitude on methods implied for assessing their educational

Mat1ock HS. Basic concepts in item and test analysis.1997[0nline].Available form URL:http://ericae.net/ft/tamu/Espy.btm No:ED406441.

Denti JA, Harden RM. A practical guide for medical teachers.Churchill Livingstone, London, England ,2001.

Shoer LA. Measurement and assessment in education. Besat Publ, Tehran, Iran, l998. [Farsi translation by Ganji H].




DOI: https://doi.org/10.22037/jme.v2i2.883

Creative Commons License
This work is licensed under a Creative Commons Attribution 4.0 International License.