asap automated system for the assessment of programming
TRANSCRIPT
![Page 1: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/1.jpg)
ASAPAutomated System for the
Assessment of Programming
![Page 2: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/2.jpg)
Project Motivation
• address the issues of teaching a technically demanding subject with discipline-specific requirements including– Increasing class sizes– Widening participation– Evolving content
![Page 3: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/3.jpg)
ASAP objectives
• Publish appropriate standards for unit tests in educational sector
• Publish tools for authoring and using unit tests
• Looking at working closely with JPlag (Plagiarism Detection) and RoboProf (Question Generation) from project partners
![Page 4: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/4.jpg)
Design
• Service based architecture – the JISC e-learning framework
• Standards – XML, WSDL, XML, SOAP
• Technologies and Tools – J2EE, Apache Axis, CVS
• User Agents – Blackboard, WebCT
![Page 5: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/5.jpg)
Automated Assessment Service
public
test
docs
student
work
student
database
private
tests
docs
1. Edit
unit
test
repo -
sitory
3. Access 4. Submit6. Feedback
Manage
7. Record
5. Evaluate
2. Produce
user agent services
application services
common services
8. Present
• Instructor creates (or edits) test documents in the unit test repository (1,2)
• Student accesses document and attempts assignment (formative or summative)
• Solution is submitted (4) and evaluated using the assessment service [private unit tests] (5)
• The result communicated to the student (6) and the database of student marks (7)
• Instructors viewdetails of assessments (8)
![Page 6: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/6.jpg)
Use Case
![Page 7: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/7.jpg)
Associated Services• Partners providing complimentary services
• JPlag – Provides Plagiarism testing on submitted code
• Roboprof (Dublin)– Provides Objective Assessment
![Page 8: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/8.jpg)
User Agents
• Generic Web Portal– Initial interface to ASAP– Evolving from a test environment
• Blackboard v6 (Kingston / de Montfort)
• Web-CT v2 (City University)
![Page 9: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/9.jpg)
TAPAS
• First stage of project• Prototype system• Currently being tested
for Java Programming Assessment at Kingston University
• 1st Gen. Self-serve• 2nd Gen. Asses. Server• 3rd Gen - WSDL• 4th Gen - eLF?
![Page 10: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/10.jpg)
TAPAS• Precursor to ASAP• Internally funded• Assessment Server
– Provides unit testing to assess Java program code
• Blackboard Building Block– VLE ‘User Agent’– Communicates with assessment server– Instructor: uploads testing code and
assignment– Learner: Downloads assignment– Uploads source code– Assessment server compiles and tests– Gives feedback and uploads results to
Blackboard gradebook
![Page 11: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/11.jpg)
Blackboard Interface
![Page 12: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/12.jpg)
Automated Java Marker Server
![Page 13: ASAP Automated System for the Assessment of Programming](https://reader030.vdocument.in/reader030/viewer/2022032721/56649cd75503460f9499f45b/html5/thumbnails/13.jpg)
Feedback from service