perfsonar update
TRANSCRIPT
![Page 1: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/1.jpg)
perfSONAR Update: Be1er monitoring = Be1er networks
Brian Tierney ESnet
Internet2 Global Summit April 29, 2015
![Page 2: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/2.jpg)
perfSONAR Toolkit 3.5: What’s Coming Next?
![Page 3: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/3.jpg)
Themes
• Support for central host management and node auto-‐configuraTon
• Support for low cost nodes • Support for Debian, VMs, and other installaTon opTons
• Modernize the GUIs Timeline: – rc1 in July: – final release in September
April 28, 2015 © 2014, h1p://www.perfsonar.net 3
![Page 4: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/4.jpg)
Expanded perfSONAR Use Cases • Current Use Case – perfSONAR Toolkit
• Includes CentOS 6 and all perfSONAR components
• New Use Cases – perfSONAR tools only
• Support for both RHEL-‐based and Debian-‐based hosts – perfSONAR hosts that are centrally managed – perfSONAR hosts that ‘self-‐configure’ – NDT only host
April 28, 2015 © 2014, h1p://www.perfsonar.net 4
![Page 5: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/5.jpg)
Current perfSONAR components • Measurement tools
– iperf3, bwctl, owamp, traceroute, etc. • Measurement archive • Central test mesh management tools • Host management tools
– Configure tests, configure NTP, etc. • Data analysis tools
– Plot data from the archive – Dashboard tools
• Lookup Service Note: perfSONAR measurement tools are extremely useful for troubleshoo8ng on their own.
April 28, 2015 © 2014, h1p://www.perfsonar.net 5
![Page 6: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/6.jpg)
User Interface Refresh • The toolkit provides an easy to use web interface targeted at
users at a variety of levels of technical experTse.
April 28, 2015 © 2014, h1p://www.perfsonar.net 6
• We intend to refresh this UI in the 3.5 release to improve easy of use, visual appeal, and integraTon of state of the art UI components to extend UI lifespan.
![Page 7: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/7.jpg)
New Management Interface
April 28, 2015 © 2014, h1p://www.perfsonar.net 7
![Page 8: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/8.jpg)
Updated psUI from GEANT
April 28, 2015 © 2015, h1p://www.perfsonar.net 8
![Page 9: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/9.jpg)
Improving Efficiency and Consistency
• perfSONAR is a very acTve project, with a conTnuous development cycle.
• We want to spend less Tme building and tesTng and more Tme developing cool new features while maintaining/enhancing quality of each release!
• Enable this by focusing on: – Automated build and release management systems – ConTnuous integraTon of code, including automated unit and system tesTng.
April 28, 2015 © 2014, h1p://www.perfsonar.net 9
![Page 10: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/10.jpg)
Improved Support for Central Management
• Goals: – Make it easy to incorporate perfSONAR hosts into exisTng host management systems (puppet, chef, SaltStack, cfengine, etc.)
– Make it easy to manage many perfSONAR hosts at a single insTtuTon
– New rpm bundles to support this
April 28, 2015 © 2014, h1p://www.perfsonar.net 10
![Page 11: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/11.jpg)
Test Node Auto-‐ConfiguraTon
• Goal: Support a perfSONAR node that will require zero configuraTon
• Site will register in the lookup service: – What hosts to run tests to – Where to send the test results
• Assumes DHCP to get node address • Primary use case is for sites with several nodes
April 28, 2015 © 2014, h1p://www.perfsonar.net 11
![Page 12: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/12.jpg)
BWCTL 2.0 • Goals – Easy to write new clients – Easy to add new tools – Support new features
• Ability to “Pause” tests • Ability to set test priority (move my test to the head of the queue) • Work without NTP sync • Restrict tesTng by Tme interval
– E.g.: only between 11pm and 6am • More fine-‐grained test limits
– Per-‐user tesTng rate, per subnet test rate, etc. – Decrease the number of ports that need opened – Easier to read/modify codebase – Backward compaTble with bwctl 1.x
April 28, 2015 © 2015, h1p://www.perfsonar.net 12
![Page 13: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/13.jpg)
perfSONAR for Network Researchers
• Vast amount of acTve measurement of interest to network researchers – perfSONAR Toolkit automaTcally collects traceroute data along with bwctl/owamp results
• New tool makes it easy to download data from perfSONAR measurement archives for analysis – esmond-‐ps-‐get-‐bulk
• Output CSV or JSON • See: h1ps://testpypi.python.org/pypi/esmond_client
April 28, 2015 © 2014, h1p://www.perfsonar.net 13
![Page 14: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/14.jpg)
Low Cost Nodes
• Lots of effort in the community to operate perfSONAR services on low cost ($100-‐$200) hardware
• High level of interest in community for low-‐cost deployment opTons (wiring closets, network engineer’s backpacks, “give-‐away” nodes, etc.)
• Want to provide a well supported and tested opTon for these users as part of pS-‐Toolkit
• More details in next talk.
April 28, 2015 © 2014, h1p://www.perfsonar.net 14
![Page 15: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/15.jpg)
Also…
• Modernize NDT, including new UI • Improve integraTon with NOC alarming systems
• Formal security review for all components
April 28, 2015 © 2014, h1p://www.perfsonar.net 15
![Page 16: perfSONAR Update](https://reader035.vdocument.in/reader035/viewer/2022081800/58668fd21a28abd33f8b77f9/html5/thumbnails/16.jpg)
Useful URLs
• h1p://docs.perfsonar.net/ • h1ps://www.perfsonar.net/ • h1p://fasterdata.es.net/ – h1p://fasterdata.es.net/performance-‐tesTng/network-‐troubleshooTng-‐tools/
• h1ps://github.com/perfsonar – h1ps://github.com/perfsonar/project/wiki
April 28, 2015 © 2014, h1p://www.perfsonar.net 16