A scoring method based on simple probability theory that considers partial knowledge and omission of answers in multiple-choice testing

Desmond Adair, Martin Jaeger

Research output: Contribution to journalArticle

2 Citations (Scopus)

Abstract

Ascheme for multiple-choice testing has been developed, based on simple probability theory, that takes into consideration partial knowledge and omissions of responses. It is tested against other methods which also take partial knowledge into account, namely, elimination testing for multiple-choice tests, as well as the conventional dichotomous method of scoring. The scheme is thought of as novel, in that it considers partial knowledge and omissions using a developed method based on probability theory. The results obtained were found to be quite similar to the 'more-complicated-to-use' elimination testing and lower results were found when compared with the conventional dichotomous method. Although the work here was undertaken to enhance testing within engineering education, there is no reason why this approach cannot be applied to any number of areas within science and arts subjects.

Original languageEnglish
Pages (from-to)974-985
Number of pages12
JournalInternational Journal of Engineering Education
Volume29
Issue number4
Publication statusPublished - 2013

Fingerprint

Testing
Engineering education
art
engineering
science
education

Keywords

  • Computer-aided assessment
  • Multiple-choice assessment
  • Scoring

ASJC Scopus subject areas

  • Engineering(all)
  • Education

Cite this

@article{d3ef8b4cae1245cab86cb77363f51c75,
title = "A scoring method based on simple probability theory that considers partial knowledge and omission of answers in multiple-choice testing",
abstract = "Ascheme for multiple-choice testing has been developed, based on simple probability theory, that takes into consideration partial knowledge and omissions of responses. It is tested against other methods which also take partial knowledge into account, namely, elimination testing for multiple-choice tests, as well as the conventional dichotomous method of scoring. The scheme is thought of as novel, in that it considers partial knowledge and omissions using a developed method based on probability theory. The results obtained were found to be quite similar to the 'more-complicated-to-use' elimination testing and lower results were found when compared with the conventional dichotomous method. Although the work here was undertaken to enhance testing within engineering education, there is no reason why this approach cannot be applied to any number of areas within science and arts subjects.",
keywords = "Computer-aided assessment, Multiple-choice assessment, Scoring",
author = "Desmond Adair and Martin Jaeger",
year = "2013",
language = "English",
volume = "29",
pages = "974--985",
journal = "International Journal of Engineering Education",
issn = "0949-149X",
publisher = "Tempus Publications",
number = "4",

}

TY - JOUR

T1 - A scoring method based on simple probability theory that considers partial knowledge and omission of answers in multiple-choice testing

AU - Adair, Desmond

AU - Jaeger, Martin

PY - 2013

Y1 - 2013

N2 - Ascheme for multiple-choice testing has been developed, based on simple probability theory, that takes into consideration partial knowledge and omissions of responses. It is tested against other methods which also take partial knowledge into account, namely, elimination testing for multiple-choice tests, as well as the conventional dichotomous method of scoring. The scheme is thought of as novel, in that it considers partial knowledge and omissions using a developed method based on probability theory. The results obtained were found to be quite similar to the 'more-complicated-to-use' elimination testing and lower results were found when compared with the conventional dichotomous method. Although the work here was undertaken to enhance testing within engineering education, there is no reason why this approach cannot be applied to any number of areas within science and arts subjects.

AB - Ascheme for multiple-choice testing has been developed, based on simple probability theory, that takes into consideration partial knowledge and omissions of responses. It is tested against other methods which also take partial knowledge into account, namely, elimination testing for multiple-choice tests, as well as the conventional dichotomous method of scoring. The scheme is thought of as novel, in that it considers partial knowledge and omissions using a developed method based on probability theory. The results obtained were found to be quite similar to the 'more-complicated-to-use' elimination testing and lower results were found when compared with the conventional dichotomous method. Although the work here was undertaken to enhance testing within engineering education, there is no reason why this approach cannot be applied to any number of areas within science and arts subjects.

KW - Computer-aided assessment

KW - Multiple-choice assessment

KW - Scoring

UR - http://www.scopus.com/inward/record.url?scp=84884187976&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84884187976&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:84884187976

VL - 29

SP - 974

EP - 985

JO - International Journal of Engineering Education

JF - International Journal of Engineering Education

SN - 0949-149X

IS - 4

ER -