novel approaches to p2p traffic optimization author:ivan klimek supervisor: assoc. prof. františek...
TRANSCRIPT
Novel approaches to P2P traffic
optimization
Author: Ivan Klimek
Supervisor: Assoc. Prof. František Jakab, PhD.
Consultant: Assoc. Prof. František Jakab, PhD.
Novel approaches to P2P traffic
optimization
Author: Ivan Klimek
Supervisor: Assoc. Prof. František Jakab, PhD.
Consultant: Assoc. Prof. František Jakab, PhD.
Outline
2
- Defining the problem - Redundancy is everywhere
- How can redundancy be avoided?
- The Proxy/Cache odyssey: from the first prototype to today
- Proxy/Cache – architecture, performance, results
- The P2P workgroup
- Conferences, publications, public opinion …
- Conclusions and the future of Proxy/Cache
Ivan Klimek – Diploma thesis - Košice - 2010
I have a dream ...
3
Internet is a mess, redundancy is the common factor of all the Internet’s problems.
Redundancy can be simply and cheaply eliminated without any negative side effects starting a completely new era of Internet …
optimal, safe and fast as never before.
Ivan Klimek – Diploma thesis - Košice - 2010
Internet is a mess
4
Protocol Type Distribution - Germany 2007, P2P represents 73.79%
P2P Protocol Distribution by Volume - Germany 2007, BitTorrent represents 66.7%
Ivan Klimek – Diploma thesis - Košice - 2010
P2P Popularity Distribution
5
Traffic generated by torrents Cache size
Ivan Klimek – Diploma thesis - Košice - 2010
Controlling the flow
6
Proxy/Cache Topology – Out-of-Band vs. In-band
Ivan Klimek – Diploma thesis - Košice - 2010
First prototype
7
First prototype architecture
Ivan Klimek – Diploma thesis - Košice - 2010
Proxy/Cache
9
Proxy/Cache SW components/architecture
Ivan Klimek – Diploma thesis - Košice - 2010
Interceptor
10
Interceptor – Schematic overview
Ivan Klimek – Diploma thesis - Košice - 2010
Coordinator
11
P2P Proxy/Cache Core Logic
Ivan Klimek – Diploma thesis - Košice - 2010
Data Visualization
12
Data Visualization Example
Ivan Klimek – Diploma thesis - Košice - 2010
P2P Caching Performance – DL/UL synthetic test
13
Proxy/Cache Downloader is 65 percent faster than the fastest common BitTorrent client – uTorrent
Ivan Klimek – Diploma thesis - Košice - 2010
P2P Caching Performance – DL real life test
14
Proxy/Cache Download Performance
Ivan Klimek – Diploma thesis - Košice - 2010
P2P Caching Performance – UL real life test
15
Proxy/Cache Upload Performance
Ivan Klimek – Diploma thesis - Košice - 2010
Proxy/Cache@TUKE
Ivan Klimek – Diploma thesis - Košice - 2010
16
The P2P Workgroup
17
Ivan Klimek - team leader, innovator
responsibilities:
* getting the idea :) * prototyping * problem solving * team coordination * public relations
Tomas Korenko - head developer
responsibilities:
* making it work :) * ...
Ivan Klimek – Diploma thesis - Košice - 2010
Marian Keltika - head system engineer
responsibilities:
* system engineering * java possible ;) * hardcore scripting
Martin Chalupka - monitoring interface development
responsibilities:
* monitoring/controlling GUI * real-time graphs and data visualization
Source: http://p2p.cnl.sk
Proxy/Cache vs. Conferences
18
INDIRECT:MANIAC Challenge 07, November 07, USDEEPSEC08, November 08, ATMANIAC Challenge 09, March 09, US
DIRECT:ITA09, September 09, UKICETA09, November 09, SKIIT.SRC10, April 10, SKTNC 2010, May 10, LT
Ivan Klimek – Diploma thesis - Košice - 2010
Protect/Warn/Disable
19
PWD Schematic Overview
Ivan Klimek – Diploma thesis - Košice - 2010
Conclusions
20
Redundancy can be completely and transparently avoided.
P2P caching is a viable solution for the increasing Internet traffic problem.
P2P caching can be done cheaply.
Proxy/Cache was developed from scratch to almost deployment ready state in less than 3 years.
Spam/DDoS/Botnets – PWD can be the final solution.
Ivan Klimek – Diploma thesis - Košice - 2010
Proxy/Cache vs. pCache
22
-From: Neilson Henriques [mailto:[email protected]] -Sent: Sunday, March 29, 2009 6:03 AM-To: [email protected]: P2P proxy/cache source code avaliabilty
-Hi Ivan,
-We are planing to develop and maintain a P2P cache in a source code model.-Actually, we are working on the Mr. Hefeeda code but the TCP Splicing used is showing-a dead end since its not scale very well in a large demand scenario.
-So I started to look for another aproach and saw your paper. Its smart and very interesting.
-Are you interested to make it avaliable to the world ?
-Thank you,
-Neilson Henriques
Ivan Klimek – Diploma thesis - Košice - 2010
Proxy/Cache vs. Capitalism
23
From: Kirill Pertsev [mailto:[email protected]] Sent: Thursday, March 11, 2010 8:48 PMTo: [email protected]; Alexander PevznerSubject: p2p cache
Hello Ivan,
We're a small startup headquartered in California, consisting of 100% Russian people, experts in TCP/IP and content delivery solutions. We're working on P2P client-side framework and on the bittorrent caching solution for ISP use. Our solution is supposed to be 'carrier grade', able to handle millions of torrents and hundreds of requests per second with a very high-performance I/O subsystem, etc, while being affordable and running on the commodity hardware.We already have software deployed at a few ISPs serving live traffic from private users. We could and would love to use a help from someone with fresh ideas and academic, though practical, approach on a mutually beneficial basis. Let me know if you're interested.
Looking forward to talk to you and best wishes in your research,-- Kirill PertsevCEO Agily Networks, Inc.Tel: 1-(408)-627-7735Cell:7-(916)-691-2577Skype: cyrilpertsev
Brazil, Russia, USA, Switzerland, UAE …
Ivan Klimek – Diploma thesis - Košice - 2010
Proxy/Cache vs. Legality
24
- Caching content as defined by the DMCA is not illegal, even storing and relaying copyrighted content for the purposes of caching is not illegal
- Klimek, I., Korenko, T.: Achievable Vision of European Digital Renaissance, A submission for the European Commission's Public consultation on "Content Online“ 2009-2010
Ivan Klimek – Diploma thesis - Košice - 2010