Scoring divergent thinking tests by computer with a semantics-based algorithm

Kenes Beketayev, Mark A. Runco

Research output: Contribution to journalArticle

13 Citations (Scopus)

Abstract

Divergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately compared with norms and semantic networks. This investigation compared the scores generated by the SBA method with the traditional methods of scoring DT (i.e., fluency, originality, and flexibility). Data were collected from 250 examinees using the “Many Uses Test” of DT. The most important finding involved the flexibility scores from both scoring methods. This was critical because semantic networks are based on conceptual structures, and thus a high SBA score should be highly correlated with the traditional flexibility score from DT tests. Results confirmed this correlation (r =.74). This supports the use of algorithmic scoring of DT. The nearly-immediate computation time required by SBA method may make it the method of choice, especially when it comes to moderate- and large-scale DT assessment investigations. Correlations between SBA scores and GPA were insignificant, providing evidence of the discriminant and construct validity of SBA scores. Limitations of the present study and directions for future research are offered.

Original languageEnglish
Pages (from-to)210-220
Number of pages11
JournalEurope's Journal of Psychology
Volume12
Issue number2
DOIs
Publication statusPublished - May 1 2016

Fingerprint

Semantics
Research Design
Equipment and Supplies

Keywords

  • Assessing creativity
  • Associative networks
  • Computer creativity
  • Creativity test
  • Divergent thinking
  • Flexibility
  • Ideas
  • Ideational fluency
  • Originality
  • Semantic networks

ASJC Scopus subject areas

  • Psychology(all)

Cite this

Scoring divergent thinking tests by computer with a semantics-based algorithm. / Beketayev, Kenes; Runco, Mark A.

In: Europe's Journal of Psychology, Vol. 12, No. 2, 01.05.2016, p. 210-220.

Research output: Contribution to journalArticle

Beketayev, Kenes ; Runco, Mark A. / Scoring divergent thinking tests by computer with a semantics-based algorithm. In: Europe's Journal of Psychology. 2016 ; Vol. 12, No. 2. pp. 210-220.
@article{7110301b63cd487e98733102ac4d823b,
title = "Scoring divergent thinking tests by computer with a semantics-based algorithm",
abstract = "Divergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately compared with norms and semantic networks. This investigation compared the scores generated by the SBA method with the traditional methods of scoring DT (i.e., fluency, originality, and flexibility). Data were collected from 250 examinees using the “Many Uses Test” of DT. The most important finding involved the flexibility scores from both scoring methods. This was critical because semantic networks are based on conceptual structures, and thus a high SBA score should be highly correlated with the traditional flexibility score from DT tests. Results confirmed this correlation (r =.74). This supports the use of algorithmic scoring of DT. The nearly-immediate computation time required by SBA method may make it the method of choice, especially when it comes to moderate- and large-scale DT assessment investigations. Correlations between SBA scores and GPA were insignificant, providing evidence of the discriminant and construct validity of SBA scores. Limitations of the present study and directions for future research are offered.",
keywords = "Assessing creativity, Associative networks, Computer creativity, Creativity test, Divergent thinking, Flexibility, Ideas, Ideational fluency, Originality, Semantic networks",
author = "Kenes Beketayev and Runco, {Mark A.}",
year = "2016",
month = "5",
day = "1",
doi = "10.5964/ejop.v12i2.1127",
language = "English",
volume = "12",
pages = "210--220",
journal = "Europe's Journal of Psychology",
issn = "1841-0413",
publisher = "Europe's Journal of Psychology",
number = "2",

}

TY - JOUR

T1 - Scoring divergent thinking tests by computer with a semantics-based algorithm

AU - Beketayev, Kenes

AU - Runco, Mark A.

PY - 2016/5/1

Y1 - 2016/5/1

N2 - Divergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately compared with norms and semantic networks. This investigation compared the scores generated by the SBA method with the traditional methods of scoring DT (i.e., fluency, originality, and flexibility). Data were collected from 250 examinees using the “Many Uses Test” of DT. The most important finding involved the flexibility scores from both scoring methods. This was critical because semantic networks are based on conceptual structures, and thus a high SBA score should be highly correlated with the traditional flexibility score from DT tests. Results confirmed this correlation (r =.74). This supports the use of algorithmic scoring of DT. The nearly-immediate computation time required by SBA method may make it the method of choice, especially when it comes to moderate- and large-scale DT assessment investigations. Correlations between SBA scores and GPA were insignificant, providing evidence of the discriminant and construct validity of SBA scores. Limitations of the present study and directions for future research are offered.

AB - Divergent thinking (DT) tests are useful for the assessment of creative potentials. This article reports the semantics-based algorithmic (SBA) method for assessing DT. This algorithm is fully automated: Examinees receive DT questions on a computer or mobile device and their ideas are immediately compared with norms and semantic networks. This investigation compared the scores generated by the SBA method with the traditional methods of scoring DT (i.e., fluency, originality, and flexibility). Data were collected from 250 examinees using the “Many Uses Test” of DT. The most important finding involved the flexibility scores from both scoring methods. This was critical because semantic networks are based on conceptual structures, and thus a high SBA score should be highly correlated with the traditional flexibility score from DT tests. Results confirmed this correlation (r =.74). This supports the use of algorithmic scoring of DT. The nearly-immediate computation time required by SBA method may make it the method of choice, especially when it comes to moderate- and large-scale DT assessment investigations. Correlations between SBA scores and GPA were insignificant, providing evidence of the discriminant and construct validity of SBA scores. Limitations of the present study and directions for future research are offered.

KW - Assessing creativity

KW - Associative networks

KW - Computer creativity

KW - Creativity test

KW - Divergent thinking

KW - Flexibility

KW - Ideas

KW - Ideational fluency

KW - Originality

KW - Semantic networks

UR - http://www.scopus.com/inward/record.url?scp=84973124560&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84973124560&partnerID=8YFLogxK

U2 - 10.5964/ejop.v12i2.1127

DO - 10.5964/ejop.v12i2.1127

M3 - Article

VL - 12

SP - 210

EP - 220

JO - Europe's Journal of Psychology

JF - Europe's Journal of Psychology

SN - 1841-0413

IS - 2

ER -