OLYMPIADS IN INFORMATICS, 2010, Vol. 4, 113-119
© Institute of Mathematics and Informatics,

ISSN 1822-7732

Validating the Security and Stability of the Grader for a Programming Contest System


Sofia University, Bulgaria J. Bourchier 5, 1164 Sofia, Bulgaria E-mail: tocho.tochev@gmail.com, tsvetan.bogdanov@gmail.com


Automated judging systems have had the tough task of ensuring the normal proceeding of programming contests for a long time. There are numerous ways proposed to secure the execution of a contestant's solution and many more actual implementations. In this article we review some criteria which the core of such systems must meet in order to be considered stable and secure. We will focus only on the core, as the functions it performs are similar across the variety of existing systems and it is the part of the system designed specifically to withstand attacks. In fact these criteria were created with their respective test cases in order to verify the grader we used in IOI 2009.


contests system, judging system, sandbox security, grader security, grader testing, grader test harness, ``black box'' testing, IOI 2009

PDFTo preview full article text in PDF format click here

Get Free ReaderYou could obtain free Acrobat Reader from Adobe

Copyright © Olympiads in Informatics, Vilnius University Institute of Mathematics and Informatics, 2010