dns query sent by heavy users and dns prefetch effect
TRANSCRIPT
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
1/18
2010 NTT Information Sharing Platform Laboratories
DNS Query Sent by Heavy Users
and DNS Prefetch EffectKazumichi Sato, Keisuke Ishibashi, and Haruhiko Nishida (NTT Laboratories)
Kota Hashimoto (NTT Comunications)
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
2/18
2 2010 NTT Information Sharing Platform Laboratories
Agenda
DNS Traffic Trends
Transition of total number of queriesTransition of number of queries sent by each user
Number of heavy users increased
Cause of Increase: DNS PrefetchDiscussion
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
3/18
3 2010 NTT Information Sharing Platform Laboratories
1. DNS Traffic Trend
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
4/18
4 2010 NTT Information Sharing Platform Laboratories
Total Number of Queries
Queries sent by users have been increasing
Inflection point during 2009/11 and 2010/03
Total#ofqueriesinday
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
5/18
5 2010 NTT Information Sharing Platform Laboratories
Number of Queries Sent by Each User
Number of Heavy users has been increasing
Inflection point during 2009/11 and 2010/03
Heavy users
Percen
tageofuse
rs(%)
# of queries in day
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
6/18
6 2010 NTT Information Sharing Platform Laboratories
2. Cause of Increase
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
7/187 2010 NTT Information Sharing Platform Laboratories
Cause of Increase in Heavy Users
What caused increase?DNS prefetch function was implemented in Firefox in
June 2009Number of Firefox users as heavy users increased
DNS prefetchResolve domain names included in URLs in the browsed
WEB page
Accelerate browsing the next page, but increase numberof queries
Google Chrome, Firefox, and Safari implement DNSprefetch
Suspect that DNS prefetch function increased
number of heavy users
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
8/188 2010 NTT Information Sharing Platform Laboratories
Validations of Suspected Cause
Query increase analysis
Compared number of heavy users who use Firefox inMar. 2010 with that in Feb. 2009
Compared number of queries sent by Firefox users in
Mar. 2010 with that in Feb. 2009
Firefox behavior inspection
Inspected prefetch queries by browsing Web pageswith large number of links
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
9/189 2010 NTT Information Sharing Platform Laboratories
Extract Firefox Users
Find hosts that resolve domain names of Firefox
or addons update serveraus2.mozilla.org
addons.update.mozilla.org
Cache server
resolving aus2.mozilla.org or
addons.update.mozilla.org
Firefox user
Note: We cannot extract all Firefox users. In addition,
we might extract users who do not use Firefox
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
10/1810 2010 NTT Information Sharing Platform Laboratories
Number of Heavy Users Using Firefox
Compared number of heavy users who use Firefox in Mar. 2010
with that in Feb. 2009
Found heavy users who sent more than 100 queries in one second
Pick up Firefox users from the above heavy users
Comparison results
Heavy users quadrupled in one year
28-times increase in heavy users who use Firefox in one year
Note: Data in table are normalized so that number Heavy Users at Feb 2009 as one.
Feb 2009 Mar 2010
Number of Heavy Users 1 4
Number of Heavy Firefox Users 0.02 0.55
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
11/1811 2010 NTT Information Sharing Platform Laboratories
Number of Queries Sent by Top Query Rate Firefox Users
Blue: Before implementing DNS prefetch (Feb. 2009)
Red: After implementing DNS prefetch (Mar. 2010)
Feb 2009: Max # of queries/sec was about
Mar 2010: Max # of queries/sec was about
Elapsed time (seconds)
#ofqueries
/sec
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
12/1812 2010 NTT Information Sharing Platform Laboratories
Number of Queries per Second Sent by Firefox Users
Firefox users sorted in descending order of max # of queries/sec
Max # of queries/sec sent by
Firefox users increased
Plots indicate max # of queries/sec sent by
each Firefox user in one hour
Blue: Before implementing DNS prefetch (Feb. 2009)
Red: After implementing DNS prefetch (Mar. 2010)
Ma
x#ofqueries/sec
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
13/1813 2010 NTT Information Sharing Platform Laboratories
Results of Query Increase Analysis
Heavy users who use Firefox have been
increasing28-times increase in one year
Number of queries sent by each Firefox user
increased after implementing DNS prefetchFeb. 2009: Max # of queries/sec is 150
Mar. 2010: Max # of queries/sec is 350
# of queries may increase using DNSprefetch function
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
14/1814 2010 NTT Information Sharing Platform Laboratories
Firefox Behavior Inspection
Prefetch query inspection
Create Web pages that include 300 links (unique URL)Browse pages with Firefox
Capture and inspect prefetch queries
Inspection EnvironmentWindows Vista SP2
Core 2 Duo 2.4 GHz2 GB Memory
Firefox 3.6
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
15/1815 2010 NTT Information Sharing Platform Laboratories
Firefox Behavior
Send 3 prefetch queries
and wait for response
Send next prefetch
query as soon as
response is returned
Stop sending query and
wait for response when
there are 3 threads
Resolve 150 out of
300 domain names
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
16/1816 2010 NTT Information Sharing Platform Laboratories
Results of Firefox Behavior Inspection
Firefox seems to control prefetch rate
Max parallel queries was 3.Max number of prefetch domain names was 150.
However, number of prefetch queries may be
double or more by OS resolvers.Windows Vista/7 sends A and AAAA queries, and it
also sends queries of domain names appended
Domain Search Suffix [TOYONO]
[TOYONO] Tsuyoshi Toyono and Katsuyasu Toyama, Clear and Present
Increase of AAAA Queries, NANOG 36.
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
17/1817 2010 NTT Information Sharing Platform Laboratories
`
3. Discussion
-
7/30/2019 DNS Query Sent by Heavy Users and DNS Prefetch Effect
18/1818 2010 NTT Information Sharing Platform Laboratories
Discussion
Filtering heavy users may block legitimate queries
So far, queries sent by heavy users have almost all beenbogus[NAKAGAMI]
Difficult to distinguish whether queries sent by heavy users
are bogus or not
It may effect on stateful middle boxes provisioning suchas FW, Large Scale NAT at ISP, enterprise networks
Session tables of those boxes may be fulfilled by small number
of prefetch browser users
If the IE implements DNS prefetch function, things mayget worse
[NAKAGAMI]Shintaro NAKAGAMI, Tsuyoshi TOYONO, Keisuke ISHIBASHI, Haruhiko NISHIDA, and
Haruhiko OHSHIMA, Large-scale DNS Caching Servers Hot Topics/An Analysis of Anomalous Queries,
2008 OARC DNS Ops Workshop