A Critical Review of Using Modified Angoff Methods for Cut-off Score Settings based on CEFR and Suggestions: A Case Study of 2 Research Articles

Abstract

        CEFR has had important impacts on English language teaching and learning in Thailand since 2014. At present, there are some research studies on mapping cut-off scores of English tests with CEFR Levels by 2 Modified Angoff Methods. Their findings may have high impacts on the students and education administrators because they are high-stakes tests. The author found that there
are many serious weaknesses in the studies, for example, they emphasize on reliability rather than validity, the methods are next to impossible to perform, they make use of statistics inappropriately for experts in the field to make their judgments, and their processes are illogical. Therefore, the author would like to point them out to the researchers and research consumers to make them realize their limitations. Some suggestions were provided for anyone who wants to conduct a similar study in the future to yield better results.