Using the Ebel method for standard setting

Physiology 2012 (Edinburgh) (2012) Proc Physiol Soc 27, SA73

Research Symposium: Using the Ebel method for standard setting

J. Harris1

1. University of Bristol, Bristol, United Kingdom.

View other abstracts by:


The Ebel standard-setting method involves rating an examination question on two dimensions. The first dimension relates to the importance of the assessed item – is it essential, important or acceptable (‘nice-to-know’) material for the students being assessed? The second dimension relates to whether the assessed item is easy, medium or hard. Each member of a panel of standard-setters completes a 3×3 grid, allocating every question to one of the nine boxes in the grid. The standard-set pass mark is determined by an algorithm in which, for example, ‘hard, acceptable’ questions push the pass mark down whereas ‘easy, essential’ questions push the pass mark up. In this workshop session participants will work in groups to complete standard-setting grids for typical ‘single best answer’ multiple choice questions across a range of physiological topics that could be included in examinations for medical students or BSc students. This will enable us to compare the outcomes from different groups of participants, and also to see whether the standard-set pass mark might differ for medical vs BSc students. Standard-setting grids that have been used in recent medical examinations in Bristol will be presented and the strengths and weaknesses of the Ebel method will be discussed.



Where applicable, experiments conform with Society ethical requirements.

Site search

Filter

Content Type