parallel computing with high performance computing clusters (hpcs) by jeremy cathey

Parallel Computing With High Performance

Computing Clusters (HPCs) 

By Jeremy Cathey

Super Computing

• Began as early as late 1950’s

• Compute large mathematical calculations

• Large scale task management

Advantages of Super Computing

• Power

• Configuration

• Administration

• Cost

• Scalability

• Diversity

Disadvantages of Super Computing

Alternatives

• Distributed Computing

- Uses queuing system to manage multiple

tasks on several computers serially

• Parallel Computing

- Uses several computers to work on one

task in parallel

Implementations of Alternatives

• Shared Processors (Multiple Processors)

• Shared Memory Pools

• Messaging Systems

Advantages of Parallel Computing• Cost

• Scalability

• Diversity

• Power

• Configuration

• Administration

Disadvantages of Parallel Computing

Parallelization Techniques

• Manual

- Parallelization implemented by the

programmer at creation of the program

• Automatic

- Parallelization implemented on the fly by

the operating system

Advantages of Manual Parallelization

• Specific Customization

• More Effective Parallelization

Disadvantages of Manual Parallelization

• Difficult to Implement

• Not Very Portable

Advantages of Automatic Parallelization

• Easier to Implement

• Portable Applications

Disadvantages of Automatic Parallelization

• Less Effective Parallelization

• Reduce Disadvantages of Parallel Computing

• Learn more about Operating System development and parallel optimization

• Provide a solution for optimized parallel computing for Dr. Salazar’s research

Project Goals

Goal Techniques

• Reduce power issue of parallel computing machines by custom building an operating system kernel for optimization

• Research and Improve Open-Mosix Parallelization Technique

• Create a cluster that is easy to assemble and disassemble

• Create and/or implement an interface that simplifies cluster administration

Operating System Choice

• Windows Vs. Linux

• Live vs. Install

• Community Support

• Creation vs. Customization

• HARDWARE SUPPORT!!!!!!!!

Bill!!!!

Implementation

• Dr. Salazar: Professor of Chemistry

• Use cluster to reduce time for sophisticated mathematical computation

Simulation Details

• 2.6 GHz Computer - 2GB RAM

• 1.2 GHz Computer - 256MB RAM

• 5 Parallel 1.2GHz Computers – 1.28GB RAM

Computer Simulation Results

0.00

10.00

20.00

30.00

40.00

50.00

60.00

70.00

80.00

0 5000 10000 15000 20000 25000 30000 35000

Number of Atoms

Ho

urs

to

Co

mp

leti

on

Group 21.2GHz

Computer Simulation Results

0.00

10.00

20.00

30.00

40.00

50.00

60.00

70.00

80.00

0 5000 10000 15000 20000 25000 30000 35000

Number of Atoms

Ho

urs

to

Co

mp

leti

on

Group 1

Group 2

2.6GHz

1.2GHz

Parallel

Computer Simulation Results

0.00

10.00

20.00

30.00

40.00

50.00

60.00

70.00

80.00

0 5000 10000 15000 20000 25000 30000 35000

Number of Atoms

Ho

urs

to

Co

mp

leti

on

Group 1

Group 2

Group 3

1.2GHz

2.6GHz

Parallel

Hurdles

• HARDWARE DETECTION!!!!!!

• HARDWARE DETECTION!!!!!!

• HARDWARE DETECTION!!!!!!

Did I Mention:

• HARDWARE DETECTION!!!!!!

• HARDWARE DETECTION!!!!!!

• HARDWARE DETECTION!!!!!!

Improvements

• Redesign Operating System Kernel For More Advanced HARDWARE DETECTION

• Try Simulations on More Advanced Computers

• Create Custom Installer for Distribution

Special Thanks

• Dr. Kirk: For providing computers for experiment and for finding a place for me to store my project

• My Wife: For not killing me while I had to store my project at our home

• Dr. Wilms: for providing older versions of Red Hat, and for Operating Systems Class

• Dr. Salazar: For time and effort spent helping me understand a SMALL part of his research

Questions? Comments? Derogatory Remarks?