A modified-Angoff study

There are a number of acceptable methodologies in the psyychometric literature for standard setting studies, also known as cutscores or passing points.  Examples include Angoff, modified-Angoff, Bookmark, Contrasting Groups, and Borderline.  The modified-Angoff approach is by far the most commonly used, yet it remains a black box to many professionals in the testing industry, especially non-psychometricians in the credentialing field.  This post hopefully provides some elucidation and demystification.  There is some flexibility in the study implementation, but this article describes a sound method.

What to Expect with the Modified-Angoff Approach

First of all, do not expect a straightforward, easy process that leads to an unassailably correct cutscore.  All standard setting methods involve some degree of subjectivity.  The goal of the methods is to reduce that objectivity as much as possible.  Some methods focus on content, others on data, while some try to meld the two.

UPDATE ON OUTCOME/ COMPETENCY-BASED MEDICAL EDUCATION

Outcome-based education is a performance-based approach that has been defined as, 'results-

orientated thinking' (Harden and Laidlaw, 2012:37-38). 

It requires:

• Learning outcomes of what is expected at the end of each phase of training to be clearly stated,

explicit and communicated;

• Decisions about the curriculum (content, educational strategies, teaching methods and

assessment) to be based on agreed learning outcomes; and

• An agreed vision that students will succeed by achieving the exit outcomes before the end of their

studies (Harden and Laidlaw, 2012:37).

Competency-based education has been defined as:

"…an approach to preparing physicians for practice that is fundamentally oriented to graduate outcome

abilities and organised around competencies derived from an analysis of societal and patient needs. It

de-emphasises time-based training and promises greater accountability, flexibility and learner-centeredness." (Frank et al., 2010:636).

As a result it may be argued that the terms 'outcome' and 'competency' – based have much in common,

with a difference in terminology a function on the geographical origin of the work.

Reflective Writing

Reflective writing is:

Ø Your response to experiences, opinions, events or new information.

Ø Your response to thoughts and feelings.

Ø A way of thinking to explore your learning.

Ø An opportunity to gain self-knowledge.