team members jernettie burney robyn evans mentor je’aime powell
DESCRIPTION
A Comparative Analysis of Localized Command Line Execution, Remote Execution through Command Line, and Torque Submissions of MATLAB® Scripts for the Charting of CReSIS Flight Path Data. Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell. Nature and Background of the Study. - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/1.jpg)
A Comparative Analysis of Localized Command Line Execution, Remote Execution through Command Line, and Torque Submissions of MATLAB® Scripts for the Charting of CReSIS Flight Path Data
Team MembersJerNettie BurneyRobyn Evans
MentorJe’aime Powell
![Page 2: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/2.jpg)
Nature and Background of the Study
![Page 3: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/3.jpg)
AbstractThe Polar Grid team was tasked with providing the Center for the Remote Sensing of Ice Sheets (CReSIS) with data that would allow signal processing through the CReSIS Synthetic Aperture RADAR Processor (CSARP) to utilize clustered computing resources without the need of MATLAB’s® proprietary Distributed Computing Environment. This research centered on the use of MATLAB® through command line, and scripted distribution through TORQUE high performance computing scheduling.
The team used flight path information from the Greenland 2007 field deployment. This data was imported into MATLAB® so that they could be converted from text files into actual MATLAB® script files. With these MEX files, the team was able to create a script within MATLAB® that could plot the flight path data into a graph with the axes of the graph being labeled latitude for the x-axis and longitude for the y-axis.
The team took the master script for the creation of the chart and ran jobs through the command line of MATLAB® to Madogo [Elizabeth City State University’s Cluster] and Quarry [Indiana University’s Cluster]. The team was then able to compare execution times from the jobs of Madogo versus Quarry. A second comparison was then tested with TORQUE job submission versus MATLAB® submission to see which performed with greater efficiency. Lastly the average execution times of all three data sets were statistically compared with a 5% significance level to determine if there was a statistically significant difference between the use of command line jobs verses TORQUE submissions.
![Page 4: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/4.jpg)
Background of the Problem•Versatility•Affordability•Better Efficiency Dr. Prasad Gogineni
Director of CReSIS
Twin Otter Carrying SAR RADAR
![Page 5: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/5.jpg)
Vocabulary• ANOVA• Binary• Cluster• Jobs • Linux
• MATLAB• Node• Perl Script• Ssh key• TORQUE
![Page 6: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/6.jpg)
Hypothesis •Multiple hypotheses:
▫Submission through TORQUE would be quicker
▫Submission of the scripts through the Quarry’s command line would be the slowest to submit
![Page 7: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/7.jpg)
Methodology
![Page 8: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/8.jpg)
Definition of the Population•Types of Data
▫CReSIS Datasets▫Run times
Madogo
Quarry
![Page 9: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/9.jpg)
Definition of Population
![Page 10: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/10.jpg)
Research Design•Defined the problem•Analyzed a solution•Performed experiment •Analyzed results
![Page 11: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/11.jpg)
Statistical Methods & Tests used•ANOVA in Excel
▫Null hypothesisH0 = μ1=μ2 =μ3
orH1 ≠ μ1≠μ2 ≠μ3
![Page 12: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/12.jpg)
Analysis of Data
![Page 13: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/13.jpg)
Visual Representation Data
1 3 5 7 9 11 13 15 17 1905
1015202530354045
TORQUEIU MATLAB ®ECSU MATLAB ®
Job Submission Trial
Tim
e in
Sec
onds
![Page 14: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/14.jpg)
Summary, Conclusions, and Recommendations
![Page 15: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/15.jpg)
Conclusions based off Statistical Analysis of the Data
Anova: Single FactorSUMMARY
Groups Count Sum Average Variance
ECSU MATLAB ® 20 84.75 4.2375 0.044536
IU MATLAB ® 20 392.6 19.63 0.216116
TORQUE 20 223 11.15 36.13421
ANOVA
Source of Variation SS df MS F P-value F crit
Between Groups 2377.481
2 1188.74 97.98694 3.587E-19 3.158843
Within Groups 691.5024
57 12.121362
Total 3068.983
59
![Page 16: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/16.jpg)
Visual Representation Data
1 3 5 7 9 11 13 15 17 1905
1015202530354045
TORQUEIU MATLAB ®ECSU MATLAB ®
![Page 17: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/17.jpg)
Challenges•MATLAB ® complier
▫Libraries•TORQUE on Madogo
▫No user shared home directory▫No shared ssh keys
![Page 18: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/18.jpg)
Future works•Create standalone applications using
MATLAB®•Research why TORQUE submissions were
slower•Direct comparisons of the clusters•MATLAB® Distributed Computing Toolkit
vs. using TORQUE to access MATLAB®
•Test using CSARP-Lite
![Page 19: Team Members JerNettie Burney Robyn Evans Mentor Je’aime Powell](https://reader036.vdocument.in/reader036/viewer/2022062520/56816427550346895dd5e649/html5/thumbnails/19.jpg)
Acknowledgements •William Blake of the University of Kansas•MathWorks Support Team•Je’aime Powell•Jefferson Davis of Indiana University