OLYMPIADS IN INFORMATICS, 2018, Vol. 12, pp. 119 - 132
© IOI, Vilnius University

ISSN 1822-7732

DOI: 10.15388/ioi.2018.10

How Hard Will this Task Be? Developments in Analyzing and Predicting Question Diffculty in the Bebras Challenge

Willem van der VEGT

Dutch Olympiad in Informatics
Windesheim University for Applied Sciences
PO Box 10090, 8000 GB Zwolle, The Netherlands
e-mail: w.van.der.vegt@windesheim.nl


Predicting the diffculty level of a task on the concepts of computer science or computational thinking, like in the Bebras Challenge, proves to be really hard. Question diffculty breaks down in content diffculty, stimulus diffculty and task diffculty. Several instruments are suggested to predict the overall diffculty level, like using a questionnaire or a rubric; these instruments are applied on the data of a recent contest and proved useful. Relative scoring could also turnout helpful. Especially on content diffculty easy applicable solutions are lacking.


Bebras contest, question diffculty, taxonomy, cognitive load theory.

PDFTo preview full article text in PDF format click here

Get Free ReaderYou could obtain free Acrobat Reader from Adobe

Copyright © International Olympiad in Informatics, 2018
Vilnius University, 2018