homework 3 responses this was meant to give you practice with data management/mining given a non...
TRANSCRIPT
![Page 1: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/1.jpg)
Homework 3Responses
This was meant to give you practice with data management/mining given a non ideally formatted input data structure
![Page 2: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/2.jpg)
Sorting and List Management
The strategy I'm testing on these shorter lists is to try and wind up with a list containing only ['year','storm id','min nonzero pressure'] - so I want to try and do it by sorting through the lists, for a given year and storm id finding the min pressure and adding to a new list... so far my attempts have been fruitless
This was the typical problem encountered by some of you
![Page 3: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/3.jpg)
Some Success
![Page 4: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/4.jpg)
![Page 5: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/5.jpg)
Many Counting Problems
![Page 6: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/6.jpg)
Producing the right file to “count”
• What is the “problem” here with the raw data file?
![Page 7: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/7.jpg)
Code to Produce a new data file
I could have filtered on “0” pressure but that would have reduced the actual number of Hurricanes carried forward
![Page 8: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/8.jpg)
Next Pass produces inital “counting” file
![Page 9: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/9.jpg)
Producing same counting file using csh scripts – practice this in csh!• 1. grep –i “HURR” master1.txt > new.txt• 2. sed s/NAMED//g new.txt > new1.txt• 3. **awk ‘{print $1 FS $6 FS $7}’ new1.txt > new2.txt• 4. sort –n –k 2 new2.txt > new3.txt
New3.txt is then a file with 3 columns in which the FIRST occurrence of unique storm ID Is the lowest central pressure
Actual files on following slides.
** could use cut –d” “ –f1 –f6 –f7 new1.txt > new2.txt but I always screw up CUT
![Page 10: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/10.jpg)
New.txt
![Page 11: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/11.jpg)
New1.txt
![Page 12: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/12.jpg)
New2.txt
![Page 13: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/13.jpg)
New3.txt
Count this file anyway you like;
Conditional IF statements are usefulFor counting.
![Page 14: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/14.jpg)
SCIENCE
An example of science that is enabled by
doing list management operations on data
bases
Current project, track analysis of Atlantic
Basic Hurricanes – all previous analysis is
only for LANDFALL events.
![Page 15: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/15.jpg)
![Page 16: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/16.jpg)
![Page 17: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/17.jpg)
Frequency:
What detection efficiency improvement happened in 1950 relative to 1940?
![Page 18: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/18.jpg)
Lots of Information!
![Page 19: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/19.jpg)
Pressure analysis for strong storms < 965 mb; 2005 is dramatic!
![Page 20: Homework 3 Responses This was meant to give you practice with data management/mining given a non ideally formatted input data structure](https://reader035.vdocument.in/reader035/viewer/2022062722/56649f355503460f94c5318f/html5/thumbnails/20.jpg)
New Important Result: Dynamics are changing; evolution is faster