«System for visual control workload of high-performance

manycores architectures»

Karpov M. A.SPbSTU, FUIT

PROBLEM

Sometimes we have many tasks on our cluster system and we cannot monitoring it. So we want to have system that:

• Provides the possibility of visual control over the workload of cores computer complex

• Analysis and performance monitoring complex and its individual components in different modes of workloads

• Advanced - a handy tool for improving parallel programs

2

VISUALIZATION

Средства визуализации

Системы визуальногопрограммирования

(Visual Programming)

Инструментывизуализации

(Program Visualization Tools)

On-line Post-mortem

3

Visualization tools

Visual Programming

Program Visualization Tools

Tools for visual data

representation

HPC SERVER 2008

• The works are based on the 16-nuclear cluster running Windows HPC Server 2008 (provided by University SPbSPU Corporation Intel) provided by using Microsoft tools and libraries and the HPC Pack HPC SDK

4

WORK AND TASKS ON CLUSTER

Job

Serial Application MPI ApplicationParametric Sweep

Application

Task Task Task Task Task

Task Task Task

Task Task Task

Task flow

Task

Task

Task

Task Task

Proc Proc Proc Proc

One JobOne Task

One JobMultiple Tasks

5

ФУИТ. Карпов М.А. 21 стр

VISUAL PRESENTATION

6

WORKING MODEL

o Visual Studio 2008o HPC.Scheduler API metaphor of the moleculeon different nuclei the same color for one problem display color states of nuclei

7

INVESTIGATION OF THE DECISION PROBLEM

What are the characteristics of the system displays the program?

• Free memory on cores• Memory allocation

processes running on the server

• Ability to monitor and change the status of implementation activities and tasks on the cluster.

8

CONTROL TASKS FLOW

Cancelled

Failed

Configuring Submitted Running FinishedQueuedSubmit Validate Activate Finish

Cancel

Cancel

Cancel

Cancel

Resubmit

Execution FailureValidation Failure

Resubmit

CONCLUSION

• Realized systematic analysis of the problem and chosen ways of technical realization

• Mastered the basic principles of using provided by Microsoft tools and libraries and the HPC Pack HPC SDK for Windows HPC Server 2008

• Appropriately developed a hierarchy of classes containing a cluster structure and a visual display, and implemented the necessary modules in C#

10

SCIENTIFIC PUBLICATIONS

• "The system for visual inspection of high-load multi-core architectures, periodicals scientific peer-reviewed journal" Scientific and technical statements SPbSTU"

• "Visualization of parallel programming" Science and innovation in technical universities: Proceedings of the National Forum of Students and Young Scientists

• "Analysis and control performance of multiprocessor architectures and their individual components", abstracts for participation in Science Week XXXVIII SPbSTU

• "The system for visual inspection of high-load multi-core architectures". Proceedings of the III session of the scientific school-workshop for young scientists and specialists "Technology High Performance Computing and computer simulation"

• The 9 th International Conference on High Performance Parallel computing on cluster systems conducted Supercomputer consortium of universities in Vladimir, Russia on the basis of the Vladimir State University

• Third session of the Scientific School-Workshop "Technologies for High Performance Computing and computer simulation“

• Third All-Russia Forum of Students and Young Scientists "Science and innovation in technical universities" conducted by St. Petersburg State Polytechnic University jointly with the Federal Agency for Education

SCIENTIFIC TRAININGS

MAIN SCIENTIFIC REWARDS

• Grant of the Government of St. Petersburg: for diploma project "System for visual inspection of high-load multi-core architectures“, 2009

• Diploma: 1 st place in the Conference-competition "Technologies of Microsoft in the theory and practice of programming", representative of Microsoft, St. Petersburg

• Diploma: "For the scientific results of fundamental and applied exploratory research", FUIT STU-up to the All-Russian Scientific Conference «XXXVII Science Week STU"

FUTURE PLANS

Theory + server realization

Receiving and processing of data about the cluster in parallel mode : C++ / TBB Web-interface:

X3D

It was

Postprocessing results

(Augmented reality, AR)

15

1) HPC processing power

2) EMC data stores

3) External parallel program for simulation of medical investigation use 1) and 2)

3) Our program investigate the characteristics of a running program on cluster and its further improvement.

THE POSSIBLE USE OF THE DEVELOPED TOOL

Thank you for your attention!

• Questions?

17

{ kapnov@gmail.com }

COMPARING

Intel Trace Analyzer

Microsoft HPC Manager

Vampir

19

CONTENTS

• Production and urgency of the task• Analysis of existing solutions• Basic principles of the proposed solutions• Details of the proposed solutions• Demonstration of experimental results• Conclusion• Future Plans

20

VISUALIZATION FOR PARALLEL COMPUTATIONS

Visualization helpsreduce the intellectual complexity of parallel programming by using a variety of techniques.

The most effective:

• dimentionality• animation21

Method of extraction of object features

22

X3DToolkit (C++) or Xj3D (Java)

Supports MPEG-4

Integration with XML

Working in real time

23