dr. john clevengerathena.ecs.csus.edu/~clevengr/209/csc209.spring... · icpc 2015‐16 dr. john...

Dr. John Clevenger• Professor of Computer Science, Emeritus

California State University, Sacramento

• Technical DirectorACM International Collegiate Programming Contest

Applied Research Areas Operating Systems

Computer Graphics

Computer Game Architecture

Programming Contests

Dr. John Clevenger -- CSc 209

What’s a Programming Contest ? Teams

Judges

Problems

Scoreboards and Scoring Algorithms

System Support Software


The International Collegiate Programming Contest (“ICPC”)

Competition between University Teams around the world

Established by ACM in 1977

Sponsored by IBM since 1997

Multi‐tiered contest

Local university contests

Regional Contests

World Finals Contest


ICPC 2015‐16


38,160 student contestants

2,534 universities

101 countries

459 sites spread over six “super‐regions”

40th Annual World Finals: May 15‐20, 2016 in Phuket, Thailand

http://icpc.baylor.edu

ICPC World Finals


Programming Contest Software Contest Control System (CCS)

Scoreboard/Presentation Systems

Contest Data Server (CDS)

Balloon Management Software

Analytic Tools

Live TV Presentations

Security Tools


Contest Control Systems


Server

Team1

Team2

TeamN

…

Admin

Automated Judge (AJ)

…

Scoreboard

Server …

Human Judge

Automated Judge (AJ)

Human Judge…


The CSUS “PC2” CCS Used in contests around the world (including at 17 different ICPC

World Finals)

PC2 Downloadsas of Spring 2014

Research Projects: PC2 Extensions

Interface to ICPC Web Services “Remote Test Run”

“Next‐Gen” Contest Control Systems About Cloud Computing “Contest as a Service”

PC2 Version 10


PC2 ↔ ICPC Web Services The ICPC Contest Management System (CMS)

https://icpc.baylor.edu/community/cmsinterface


CMS

Contest 1

Contest N

…

Contest AdminDefine Contest*

Register for Contest*Teams

Upload Results*

Web

Ser

vices

REST endpoints for:• Obtaining contest info

(teams, contests, social media,…)• Uploading results

*Manual interactive processes

Web Client

PC2 v9 PC2 v10

ICPC Interface

PC2 “Test Runs”


Admin

Teams

PC2 Server

Run

Compare

PC2 v9 TeamProblem: Language: Source File:Add’l Files:

Test Submit

acceptSubmission():

Compile

Execute

Validate

return Judgment

Executable File

Output File

Judge’s Answer

File

EW Web TeamProblem: Language: Source File:Add’l Files:

Submit

PC2 v10 TeamProblem: Language: Source File:Add’l Files:

Submit

CompileExecute

Show Output

acceptSubmission():

Compile

Execute

if (judgedRun){Validatereturn

Judgment} else {

return Output

}

JudgmentTest

Test

Cloud Computing


What IS “cloud computing”?

The Cloud Computing Secret:


Cloud Computing Models


Infrastructure as a Service (IaaS)(Virtual machines, servers, storage, …)

Platform as a Service (PaaS)(Programming tools, databases, web servers, …)

Software as a Service (SaaS)Email, messaging, payroll processing, CAD, accounting,

customer relations, games and VR, …

Web clients

(browsers,

mobile apps,

thin clients,

terminal emulators,

…)

Contest as a Service (CaaS)


Software as a Service (SaaS)

Contest Server

Contest Admin

Contest AutoJudge

Contest Human Judge

Contest Team

Contest Scoreboard

ContestAdmins, Judges, Teams,

Spectators,…

CaaS Requirements Contest setup

Component “spin‐up” servers, admins, teams, judges “as needed”

Scalability Load balancing/monitoring

Use existing support facilities Application servers (TomCat, Jetty, Websphere) Docker, Cloud Foundry Cloud Service Providers

o Amazon WS, Google AppEngine, Microsoft Azure, IBM Bluemix, ….


CaaS: PC2 Version 10


AppServer

Jetty WebServer

Jersey REST

Services

MySQLDatabase

…

Spawn Machines

Resource Manager

Jetty

Dispatcher

Jetty

Checker

JettyRun

Compare

Compile

…

Spawn additional machines as needed

Http Requests

Projects Next‐Phase

Remote machine spawning Load Balancing

Front‐end Back‐end

Virtualized Auto‐Judging Analysis

Down‐the‐road Database Optimization Status Tracking Cheating Detection


Remote Machine Spawing Spawned machines are currently Local JVM’s… Need to generalize the spawning operation

Remote machines VMWare virtual machines Docker Containers


AppServeron Remote host

Spawn Machines

Resource Manager

Dispatcherin Docker Container

Checker on VMWare VM

…

… …

AppServeron VMWare VM

Dispatcheron Remote Host

Front‐end Load Balancing Users need a single set of URLs (REST endpoints) Multiple AppServers must respond to the same URLs… Need a front‐end balancer/router

“Pound” (http://www.apsis.ch/pound)


AppServer1

Spawn Machines

Resource Manager

…

AppServer2

AppServer3

Load Balancer

Http Requests to fixed Contest

URLs

Admins, Judges, Teams, Spectators

?

Back‐end Load Balancing Resource Manager automatically starts (one) AppServer,

Dispatcher, & Checker How does it determine when more are needed?

RM must implement “system monitoring”


AppServer1Spawn at Startup Resource

Manager

Dispatcher1 Checker1

…

AppServer2 Dispatcher2 Checker2

Load Monitor

… …

Check load

Spawn new modules

Virtualized AutoJudging Current approach: VM servers,

physical judges

Can Judging be done on VMs ? Fairly? Efficiently?

Difficulties: Differences between physical and virtual judges Differences between distinct virtual judges


Server

TeamN

Team1

AJ … AJ

…

Future Plans Database Optimization for Scalability

Configure various Master/Slave DBMS configurations Use tools such as Locust to find optimal configuration under loading

Status Tracking Provide SysAdmins with tools to show module status/state, history,

traffic, etc.

Cheating Detection Create a facility modeled on “intrusion detection” systems

Examine network logs, network access patterns Compare team submissions (including changes over time) for

“software similarity”


Background/Experience Java (preferably JavaEE)

Web services Application Servers (Tomcat, Jetty, …) REST principles Web protocols and standards

HTTP/S, HTML, JSON, XML, …

Good English writing skills

A Penchant for Programming!


Contact Info / Resumes:Dr. John Clevenger

email: [email protected]

office: RVR 5018

Hours: by appointment

Thank You!


dr. john clevengerathena.ecs.csus.edu/~clevengr/209/csc209.spring... · icpc 2015‐16 dr. john...

Documents