Semi-Automati c Assessmentof Unrestrained Java Code

David Insa CabreraUniversitat Politècnica de Vàlencia (UPV)

ASys: Demo

Outline

Problem to solve

ASys (Assessment system)

Analisys of the propertiesArchitecture of the system

DFD to mark one examTesting using test cases

Future work

The beginning of the project

Inconsistency in marks awarded by different examiners

Detected problems

Different interpretation of the marking criteria Mark errors cancel each others Teacher bias in awarding marks to different students

Reduce marking time

Objectives to achieve

Remove marking subjectiveness Increase marking precision Ensure the same marking criteria are applied to all students irrespective of their group, time, location, and examiner

Pilot project (2014-2015)

We implemented ASys (Assessment System)All final exams of one subject were marked twiceo Normally and without knowledge of the pilot projecto With ASys (without any assessment impact)

ASys: Demo

Outline

Problem to solve

ASys (Assessment system)

Analisys of the propertiesArchitecture of the system

DFD to mark one examTesting using test cases

Future work

ASys: Architecture

Student’s solution

Marking template

Code analisys using Java Reflection

Report

ASys: Analisys

JavaCompiler

Student’s solution

Teacher’s solution

Student’s solution

Teacher’s solution

Test cases generator

JVM

InputInputInputInput

OutputOutputOutputOutput

Test cases validator

Report

ASys: Testing

ASys: DFD

ASys: Demo

Outline

Problem to solve

ASys (Assessment system)

Analisys of the propertiesArchitecture of the system

DFD to mark one examTesting using test cases

Future work

ASys: Demo

ASys: Demo

Figure Volume

ASys: Demo

Outline

Problem to solve

ASys (Assessment system)

Analisys of the propertiesArchitecture of the system

DFD to mark one examTesting using test cases

Future work

Future work

Version of ASys for the students

o Can solve their questions without waiting for the teachero Correct on their own the exams after the submission

Evaluate the usefulness of the tool with 1500 students

o To do the exerciseso To take the examso Poll at the end of the year

Thank you

David Insa Cabrera