hidden universes of information on the internet

61
Hidden Universes of Information on the Internet Rev. 12/2012 Russ Haynal Internet Instructor, Speaker, and Paradigm Shaker 21015 Forest Highlands Ct Ashburn, VA 20147 http://navigators.com Phone : 703-729-1757 [email protected] If you send me an email, put “internet training” in the e-mail's subject

Upload: kylar

Post on 14-Jan-2016

36 views

Category:

Documents


10 download

DESCRIPTION

Russ Haynal. Internet Instructor, Speaker, and Paradigm Shaker. 21015 Forest Highlands Ct Ashburn, VA 20147. Phone : 703-729-1757 [email protected]. http://navigators.com. Hidden Universes of Information on the Internet. Part 2. Rev. 12/2012. - PowerPoint PPT Presentation

TRANSCRIPT

Page 1: Hidden Universes of  Information on the Internet

Hidden Universes of Information on the Internet

Rev. 12/2012

Russ Haynal Internet

Instructor, Speaker, and Paradigm Shaker

21015 Forest Highlands CtAshburn, VA 20147

http://navigators.com

Phone : [email protected]

Note: If you send me an email, put “internet training” in the e-mail's subject

Page 2: Hidden Universes of  Information on the Internet

Page 2

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Course Outline

Session Goal: Strengthen your Internet skills.

(focused, accurate, successful)

Course Outline:

• Advanced Search Tools and Techniques• Country-Specific Content• Country-Specific Infrastructure• Advanced Tools and Traceroute Details• Paradigm Shake-up

specific_page.html

Online Web page = http://navigators.com/opensource.html

Page 3: Hidden Universes of  Information on the Internet

Page 3

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Internet’s Growth Continues stats.html

www.glreach.com

Page 4: Hidden Universes of  Information on the Internet

Page 4

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Which have you bookmarked?

• Advanced search page can be used just as easily as basic search page.

• Seeing the options might remind you to use them

Basic search Advanced Search

Key Tip: Limit your searches to PDF or Powerpoint files to quickly locate detailed content

from great web sites.

search_tools.html

www.google.com/advanced_search and www.google.com/preferences

Page 5: Hidden Universes of  Information on the Internet

Page 5

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/search.yippy.com

• Yippy examines the first couple hundred hits, and groups them together into “clouds”

• View the 10-15 hits you really want without reading through 200 mixed search results.

• Saves you lots of time.

search_tools.html

• Ixquick.com - searches 10 other search tools

• Stars show number of search engines that gave site a top 10 ranking.

• Illustrates that search engines each have their own ranking algorithm

Page 6: Hidden Universes of  Information on the Internet

Page 6

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/

Alexa.com

• Like most toolbars, it “spies” on its users• Most of the information collected via the tool bar is

available at alexa.com

search_tools.html

• This is a great way to discover new websites based on the traffic patterns of millions of Alexa Toolbar users

• Click on “site info”

• Enter a Domain name

• Click “get details” and then “related links” & “traffic stats”

Page 7: Hidden Universes of  Information on the Internet

Page 7

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Search Engine Comparison• There are several comprehensive online guides

to search engines• Read them & Compare :-)

• Some sites include PDF versions for easy print-out/ reference

search_tool_details.html

Page 8: Hidden Universes of  Information on the Internet

Page 8

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/www.archive .org

• Surf through previous copies of a web site.

• Deleting sensitive information from today’s web server does not remove it from archive.org

• Archive.org robot collects web pages like other search engines

• Previous web page copies are not deleted

Web Servers

RobotUser

Interface

Recent copy

copied Web page

Archive copies

User PC

• “document not found”? – Paste the address into archive.org

• Viewing archived web pages will cause hits to live target website

persona_example.html

Page 9: Hidden Universes of  Information on the Internet

Page 9

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Archives of your data.

How much of your information remains online in archives like the “wayback machine”?

Page 10: Hidden Universes of  Information on the Internet

Page 10

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Surfing Upstream vs. Downstream

#1 Most researchers follow the links “downstream” from an interesting page

#2 Shows pages that link towards the target (=upstream) This is an Indication of the page’s “popularity” (= who knows about target.com)

#3 Shows pages that have links to both target sites … will show “user pages” for the that topic

Target.com

Target.com Target.com Target2.net

#3#2

“Upstream” “Joe’s guide to MANY targets”

search_upstream.html

#1

Page 11: Hidden Universes of  Information on the Internet

Page 11

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Be Creative When Surfing Upstream

Example: Washington DC Tourist Sites

• Any combination of these target pages will lead you to “DC Tourism” pages, but certain pairings may also lead you to subject-specific pages

www.spymuseum.org

www.nasm.si.edu(air & space museum)

www.fordstheatre.org

www.kennedy-center.org

Theatre links DC TourismMuseums / Educational

search_upstream.html

Page 12: Hidden Universes of  Information on the Internet

Page 12

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Surfing Upstream Details

• You need to decide which scenario makes more sense; Row #1 or Row #2

• A 3rd and 4th site can be added if they are popular enough

search_upstream.html

search format at blekko.com Search Results

link:http://www.example.com contain hyperlinks toward example.com

link:http://www.example.com/pageA.html contain hyperlinks toward the specific page

link:http://www.example1.com link:http://www.example2.com

contain hyperlinks towards both example sites.  This is a great way to discover “user pages” (i.e. Joe's guide to many example-sites)

search format at google or bing Search Results

“www.example.com” contain text: www.example.com

“www.example.com/pageA.html” contain text of the specific page address

“www.example1.com” “www.example2.com”

contain text of both example site addresses.  This is a great way to discover “user pages” (i.e. Joe's guide to many example-sites)

Page 13: Hidden Universes of  Information on the Internet

Page 13

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Searching within a site or domain name

• This technique can save you weeks of search time

• Much faster than reading through thousands of web pages from a large website.

• “use your imagination” to focus these searches.

search_upstream.html

search format at google Search Results

site:example.com

pages hosted on any kind of example.com servers (www.example.com, blog.example.com, etc). This is a quick way to assess the size/depth of a web domain

site:example.com searchtermpages hosted on example.com servers which mention the "searchterm"

site:ru searchtermpages hosted on .ru web servers which mention the "searchterm"

site:ac.ru nuclearpages hosted on any academic .Russian web servers which mention nuclear

site:iaea.org iran filetype:pdfPDF documents hosted at iaea web servers which mention iran.

Page 14: Hidden Universes of  Information on the Internet

Page 14

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/

Example: Iranian cell phone Company (Irancell-MTN)

Government Regulations, license site:gov.ir irancell

Industry MagazineNews, vendors, maps,Management interviewssite:gsmworld.com iran

Construction vendorTowers, networkssite:vendorsname.com iran

Equipment vendorPhones, networksPress announcementsite:nokia.com iran

Res

ume’Employees

Resumes,Job Postingsresume irancellsite:linkedin.com irancell

CustomersService issues, technology insightsIrancell forum postSite:mob.ir irancell

Topic’s own websiteMarketing informationPress announcementsite:irancell.ir

Investors Ownership, disclosures

search_upstream.html

Who knows about your topic? (google search terms in red)

Page 15: Hidden Universes of  Information on the Internet

Page 15

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/

The Edgar Database

• Most publicly held companies are required to file financial statements with the Securities Exchange Commission (SEC)

• These filings are accessible to the public through the SEC’s EDGAR Database

• READ forms 10-Q (quarterly report) and 10-K (annual report). These are very detailed reports about the company’s activities, plans, sales, etc

• Seek out other business databases: financial, investment, government regulatory, etc

Business Databases Can be Quite Usefulsearch_tool_specialized.html

Page 16: Hidden Universes of  Information on the Internet

Page 16

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Industry Specific Resources• There is a wealth of online information related to specific industries

(technical, regulatory, marketing, professional societies etc.)

Page 17: Hidden Universes of  Information on the Internet

Page 17

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Course Outline

Session Goal: Strengthen your Internet skills.

(focused, accurate, successful)

Course Outline:

• Advanced Search Tools and Techniques• Country-Specific Content• Country-Specific Infrastructure• Advanced Tools and Traceroute Details• Paradigm Shake-up

Page 18: Hidden Universes of  Information on the Internet

Page 18

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Many country resources are onlinecountry_specific_content.html

Phone books

Page 19: Hidden Universes of  Information on the Internet

Page 19

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Comparing Two Russian Search tools...

(query format is for www.blekko.com)

• how many web pages link toward the search tool

• You could also test the popularity of these sites at alexa.com (under “site info”)

• Surf upstream to find another list of russian search tools

link:http://www.bigmax.ru 400 Pages Found

link:http://www.aport.ru2000 pages found

country_specific_content.html

Page 20: Hidden Universes of  Information on the Internet

Page 20

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Many countries sell their domains

• These were just some of the country domains available for sale

• “All Domains” happens to be a licensed “registrar” for these countries

• There are many additional countries who will sell their domain names to “anyone”

domain_name.html

Page 21: Hidden Universes of  Information on the Internet

Page 21

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Learn about the 2-letter code

• Visit that country’s domain name registrar

–www.iana.org/domains/root/db OR

–www.norid.no/domenenavnbaser/domreg.html

• What is the policy for getting a domain name? (citizenship, trademark, local presence, money)

–What is the cost to register a domain name?

–Are there any censorship clauses?

• Does the Registrar require any proof of identity? (drivers license, passport, business license)

• Is there a whois service? (make a bookmark)

domain_name.html

Page 22: Hidden Universes of  Information on the Internet

Page 22

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/

• An Analysis of domain name policies

http://www.norid.no/regelverk/rammer/regelverksmodeller.en.html

domain_name.html

Notice: Most countries sell their domain names to “anybody”

Page 23: Hidden Universes of  Information on the Internet

Page 23

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Example of Domains for Sale

• Less than one third of Haiti domain names are registered to people with an address in Haiti

• Almost half of Haiti’s Domain names are registered to U.S Addresses.

• When you see a .ht website… is it necessarily foreign?

IcelandFall 2008

• Notice the spike in foreign-owned domain names when during Iceland’s 2008 financial Crisis

UnitedStates

Haiti

.HT Domain Owners

domain_name.html

Page 24: Hidden Universes of  Information on the Internet

Page 24

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Course Outline

Session Goal: Strengthen your Internet skills.

(focused, accurate, successful)

Course Outline:

• Advanced Search Tools and Techniques• Country-Specific Content• Country-Specific Infrastructure• Advanced Tools and Traceroute Details• Paradigm Shake-up

Page 25: Hidden Universes of  Information on the Internet

Page 25

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Country-Specific Infrastructure

• There are many different scenarios for a county’s connectivity

• A “clear picture” will emerge after many Inter-country traceroutes

– Initiate traceroutes in both directions (inbound & outbound)

• Online web page has a detailed narration of many scenarios

– example: How ISP “D” communicates with ISP “J”

IX

IXIX

USA

Country 1

Country 3Country 2

Country 4

A

B

H

G

FE

DC

B B

J

K

I

L

M NIXGlobal ISP Internet Exchange

Local / regional ISP Each letter labels 1 ISP

country_specific_infrastructure.html

Page 26: Hidden Universes of  Information on the Internet

Page 26

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/US-Centric Traceroutes

3 s7.ten-mr2-csir.uni.net.za 7 48NA209.sdn.net.za 8 wash-jhb-fr2.sdn.net.za 9 sdn-co-za-gw.digex.net 11 dca6-core2.atlas.digex.net 13 iad1-core11.atlas.digex.net 14 icm-mae-e-f0/0.icp.net 15 icm-bb1-dc-0-1-T3.icp.net 16 icm-bb10-dc-0-0.icp.net 17 icm-bb2-dc-1-0-0.icp.net 19 icm-bb11-pen-9-0.icp.net 21 usnyk105-tc-p0-0.ebone.net 22 gblon504-tc-p6-0.ebone.net 24 bebru203-tc-p2-0.ebone.net 25 nlams303-tc-p1-0.ebone.net 26 dedus205-tc-p1-0.ebone.net 28 sesto501-tb-p4-2.ebone.net 30 195.158.226.54

• 2000 CAIDA Study: “Measurements of the Internet topology in the Asia-Pacific Region”

• The U.S. is the major Internet transit intermediary for the rest of the world: 71% of traces that neither start nor end in the U.S. still pass through it.

Example: South Africa to Russia via US

Jan/2000 Apr/2002

traceroute.html

Apr/2005

A mapping of IPV6 shows Europe as the new “center” (As of Aug 2010)

Page 27: Hidden Universes of  Information on the Internet

Page 27

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/How Does it Work?• Internet started as “Packet Switching Networks” using TCP/IP

(Transmission Control Protocol - Internet Protocol)

• Every Internet connection has a unique IP Address consisting of 4 numbers, each number has a range of 0-255 (ie. 198.211.16.134)

• Internet IP numbers are allocated through a hierarchy

– IANA --> ARIN/RIPE/APNIC/LACNIC/AFRINIC --> ISP’s /Company/Country

• Routers direct your packets of information along the “preferred” path

Router Router

Router

Router

Router

Router

RouterRouter

Note: The next generation of IP Address space (IPV6) is quite LARGE3,911,873,538,269,506,102 IP #’s per square meter of the Earth's surface 4,500,000,000,000,000 IP#’s for every observable star in the known universe

traceroute.html

Page 28: Hidden Universes of  Information on the Internet

Page 28

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Asymmetric Routing

1 bb (200.160.2.1) 0.254 ms 2 gw01 (200.160.0.228) 0.435 ms 3 200.142.94.157.metrored.net.br 3.991 ms 4 rbcor2-atm.rjo.metrored.net.br (200.225.76.222) 6ms 5 rbcor1-atm.rjo.metrored.net.br (200.225.72.213) 8ms 6 BRASIL-STM1-pm2R1-pacorR1.metrored.net 118 ms 7 bar3-serial4-1-0.Miami.cw.net (208.173.80.201) 118 ms 8 acr2-loopback.Miami.cw.net (208.172.98.62) 123 ms 9 -loopback.Washington.cw.net (206.24.226.103) 147 ms 10 dcr1-so.Washington.cw.net (206.24.238.57) 147 ms 11 bcr2.Thamesside.cw.net (166.63.210.62) 238 ms 12 zcr2-loopback.Londonlnt.cw.net (166.63.210.19) 239 ms 13 oscar.LON.router.COLT.NET (212.74.64.217) 231 ms 14 ar3.haj.de.colt.net (213.61.232.42) 260 ms 15 213.61.144.18 (213.61.144.18) 261 ms 16 pop9.pop-hannover.de (193.98.1.212) 263 ms 17 cishelios2.helios.de (193.141.98.1) 268 ms 18 proxy.helios.de (193.141.98.37) 268 ms

1 cishelios2.helios.de (193.141.98.1) 3 ms2 pop9.pop-hannover.de (193.98.1.212) 6 ms 3 popcore.pop-hannover.de (193.98.1.213) 7 ms4 ar3.haj.de.colt.net (213.61.144.17) 6 ms 5 213.61.232.45 (213.61.232.45) 6 ms 6 pos1-kyle.NYC.router.COLT.NET (212.74.74.169) 107 ms 7 so-4-1.nycmny1-hcr3.bbnplanet.net (4.25.133.37) 107 ms 8 nyc4so.xnycmny4-uunet.bbnplanet.net (4.0.2.42) 108 ms 9 0.so-6-0-0.XL2.NYC4.ALTER.NET (152.63.21.82) 108 ms 10 0.so-2-0-0.TL2.NYC8.ALTER.NET (152.63.0.185) 112 ms 11 0.so-7-0-0.TL2.ATL5.ALTER.NET (152.63.146.41) 126 ms 12 0.so-7-0-0.XL2.MIA4.ALTER.NET (152.63.86.193) 142 ms 13 POS7-0.GW7.MIA4.ALTER.NET (152.63.85.29) 142 ms14 POS2-1.IG3.MIA4.ALTER.NET (65.208.80.142) 147 ms 15 MIAMI-STM1.metrored.net (200.49.77.14) 148 ms 16 BRASIL-STM1-.metrored.net (200.49.77.6) 259 ms 17 rjo.metrored.net.br (200.225.72.214) 261 ms18 spo.metrored.net.br (200.225.76.221) 268 ms19 .metrored.net.br (200.142.94.158) 267 ms20 bb.registro.br (200.160.0.226) 268 ms 21 registro.br (200.160.2.3) 267 ms

www.helios.de registro.fapesp.br

Germany BrasilVia New York, Atlanta, Miami

Brasil GermanyVia Miami, Washington, London

traceroute.html

You can try this with any two sites listed at traceroute.org

Page 29: Hidden Universes of  Information on the Internet

Page 29

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Some Definitions...• Telco - Company that own physical networking

infrastructure (Fiber in the ground, switches, etc.) A Telco is often regulated by their country’s government

• “Real ISP” - ISP’s that directly operate an IP network (Routers, Data Circuits) Data Circuits may be obtained (long term lease) from the local telco

• “misc ISP” - ISP’s that depends on the “real ISP’s” for their existence. A “misc ISP” may be a very small localized ISP who depends on a “real ISP” for connectivity to the rest of the Internet. A “misc ISP” may also be a reseller of the “real ISP’s” services

• Note: Many “telco’s” and “real ISP’s” are are part of the same company. Sometimes referred to as a “facilities-based ISP”

Page 30: Hidden Universes of  Information on the Internet

Page 30

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/"Country-Specific Infrastructure"

• Identify exchange points which serve that country or regional area

• Exchange points may list connected ISPs

• Exchange points may also mention telco providers, which provide infrastructure (fiber) to the ISPs

• Identify the ISPs which provide service in that country

• Examine the ISPs’ backbone maps

• Watch for upstream providers, peering partners, and exchange points

• Initiate multiple traceroutes in/out of target country

A top-down approach…

country_specific_infrastructure.html

Page 31: Hidden Universes of  Information on the Internet

Page 31

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Exchange Points

• Visit the home page for each exchange point in your area.

• Who operates the exchange point?

• Look for the address of the exchange point

• Look for list of telcos which provide circuits to the exchange point

– May be described under FAQ’s or “how to connect”

• Look for list of ISPs which that are connected

• Do they provide a traceroute or a “looking glass” page?

– Look under “tools” or “support”

country_specific_infrastructure.html

Page 32: Hidden Universes of  Information on the Internet

Page 32

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/An Exchange Point can contain a wealth of informationcountry_specific_infrastructure.html

Page 33: Hidden Universes of  Information on the Internet

Page 33

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Global Carriers

• Carriers such as AT&T, Sprint, Tata Communications, etc. are part of a core set of Telcos which partner to build infrastructure

• Many ISP’s will get their international connections through these handful of carriers

country_specific_infrastructure.html

Page 34: Hidden Universes of  Information on the Internet

Page 34

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Who Owns the Company?

• An ISP’s Map usually represents data circuits which must eventually be mapped to a physical circuit

• UUNET happens to be owned owned by Verizon

country_specific_infrastructure.html

UUNET

Page 35: Hidden Universes of  Information on the Internet

Page 35

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Regional ISPs

• Notice how these regional ISP’s inter-connect with many Exchange Points

• You would expect intra-county traffic to not criss-cross the Atlantic through the U.S.

Carrier1

country_specific_infrastructure.html

Page 36: Hidden Universes of  Information on the Internet

Page 36

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/European Backbone

• This regional backbone extends across to the U.S.

• Ebone shows that they have U.S Connections at the Sprint NAP, and also with GTE, Sprint

country_specific_infrastructure.html

In a traceroute…Penn = Pennsylvania?Penn = Pennsauken, NJ

Page 37: Hidden Universes of  Information on the Internet

Page 37

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Country-Specific Backbone

• Shows the ISP’s network within one country

• Note the links outward to numerous peering points

• Note the “uplinks” outward to C&W, Ebone, DFN

country_specific_infrastructure.html

Page 38: Hidden Universes of  Information on the Internet

Page 38

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/City-Specific Infrastructure• City-wide Map of Fiber Network in Moscow close-ups reveal access points

country_specific_infrastructure.html

Washington DC

Dulles

Page 39: Hidden Universes of  Information on the Internet

Page 39

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Vendors Reveal Details...A telco’s press announcements may tell you which vendors helped build their infrastructure

country_specific_infrastructure.html

Page 40: Hidden Universes of  Information on the Internet

Page 40

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Still looking for ISPs? country_specific_infrastructure.html

• Use a county-specific search tool– http://www.iranyellowpages.net/

• Traceroute towards websites hosted within the country– Sites within country = homepages of universities,

governments, Exchange Points, traceroute servers at traceroute.org

• Surf Upstream from several country ISPs

Page 41: Hidden Universes of  Information on the Internet

Page 41

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Web Hosting “Farms”• Hosting environment that is secure, server-friendly and

well connected to the Major ISP’s• May provide complete services including content

development, server management.• Others offer “rack-space” and utilities for co-location of

User-supplied equipment

see: datacentermap.com

country_specific_infrastructure.html

Page 42: Hidden Universes of  Information on the Internet

Page 42

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Third-party Sites Filled with Resourcescountry_specific_infrastructure.html

Page 43: Hidden Universes of  Information on the Internet

Page 43

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Course Outline

Session Goal: Strengthen your Internet skills.

(focused, accurate, successful)

Course Outline:

• Advanced Search Tools and Techniques• Country-Specific Content• Country-Specific Infrastructure• Advanced Tools and Traceroute Details• Paradigm Shake-up

Page 44: Hidden Universes of  Information on the Internet

Page 44

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Connection Detective

Three Online Scenarios

• Target may put servers at local/remote locations based on bandwidth issues, costs, security, local skills, etc

• Trace to www.target.com does NOT always = target’s access provider

Mailserver

InternetWebserver

target

#1: All servers are hosted at target location

#3: Only one server is hosted at target location

#2: All servers are hosted with an online provider.Note: servers can be with different providers

connection_detective.html

Page 45: Hidden Universes of  Information on the Internet

Page 45

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Finding a domain’s servers...

DNS Records show names of web servers and mail servers

Results for: fool.com primary name server = ns1.fool.com responsible mail addr = dns.fool.comMX preference=100, mail exchanger=mail.uu.netMX preference =5, mail exchanger = spot.fool.comMX preference =10, mail exchanger = fido.fool.comMX preference =50, mail exchanger= mail13.motleyfool.comfool.com internet address = 208.51.76.1ns1.fool.com internet address = 207.138.33.118ns2.fool.com internet address = 208.51.76.222mail.uu.net internet address = 199.171.54.106spot.fool.com internet address = 208.241.66.9fido.fool.com internet address = 198.83.60.55mail13.motleyfool.com internet address = 208.241.66.23

Now run traceroute to the web server and mail servers

connection_detective.html

Page 46: Hidden Universes of  Information on the Internet

Page 46

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Use a Swiss Army Knife...

• There are many websites that enable you to do traceroute, whois, DNS look-up, etc.

• Some website will limit how many queries you can do (from a single IP address)

connection_detective.html

robtex.com

Page 47: Hidden Universes of  Information on the Internet

Page 47

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Looking in the neighborhood

• Reverse DNS Lookup - - Enter IP #, and it identifies associated Domain Name (if defined)

• Some Tools will do this for a series of IP numbers

• example search for neighbors of www.gov.ru 194.226.80.66 ipaccess.gov.ru 194.226.80.77 ns.gov.ru 194.226.80.78 www.council.gov.ru 194.226.80.88 apparat.gov.ru 194.226.80.129 apollo.gov.ru 194.226.80.145 ns.vpk.gov.ru 194.226.80.146 ts.vpk.gov.ru 194.226.80.147 ia.vpk.gov.ru 194.226.80.159 president.kremlin.ru 194.226.80.160 www.gov.ru 194.226.80.162 council.gov.ru 194.226.80.163 award.adm.gov.ru

194.226.80.164 kazak.adm.gov.ru 194.226.80.165 lib.adm.gov.ru 194.226.80.166 orgdiv.adm.gov.ru 194.226.80.167 protocol.adm.gov.ru 194.226.80.168 udprf.gov.ru 194.226.80.169 Msu.gov.ru 194.226.80.170 www.government.ru 194.226.80.171 www.youth.gov.ru 194.226.80.172 www2.scrf.gov.ru 194.226.80.173 www.vneshpol.gov.ru 194.226.80.177 time.gov.ru 194.226.80.187 mylex.gov.ru

connection_detective.html

Page 48: Hidden Universes of  Information on the Internet

Page 48

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Autonomous System Numbers (ASNs)

Router Router

Router

Router

Router

Router

RouterRouter

AS701AS14312

AS512

• Most Internet providers have an Autonomous System Number

• ASN’s are part of the announcement of “routing policies” between ISP’s. BGP= Border Gateway Protocol)

• Global internet routing tables contains “all” such announcements.

“Traceroute = a path at individual router level”“AS Mapping = paths at ISP level of detail”

connection_detective.html

Page 49: Hidden Universes of  Information on the Internet

Page 49

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Mappings of Autonomous Systems

• maps the routes towards a specific AS.

• some of these websites require Java

• Fixedorbit.com has text interface

connection_detective.html

Animation shows routing fluctuations

source: robtex.com

source: http://bgplay.routeviews.org/

Page 50: Hidden Universes of  Information on the Internet

Page 50

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Traceroute Tips

• Initiate traceroutes towards websites hosted within your country (target pages= ISP’s, exchange point, country registrar, other Traceroute Servers, etc.)

• Initiate traceroutes from diverse geographic starting points.

• If possible, Initiate traceroutes from within the country heading outward (try traceroute.org) or search for: traceroute domain:ru

• Are there key ISP’s / exchange points that appear in most of these traceroutes?

Page 51: Hidden Universes of  Information on the Internet

Page 51

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/

Try different starting pointsfor Traceroutes

Starting from Arizona University 1 128.196.128.253 0 ms 2 192.80.43.25 0 ms3 192.80.43.58 1 ms 4 207.250.65.133 5 ms 5 core-02-ge.phnx.twtelecom.net 5 ms 6 core-02-so.chcg.twtelecom.net 46 ms7 peer-01-ge.chcg.twtelecom.net 46 ms8 aads.verio.net 47 ms9 p4-6-0-0.chcgil01.us.bb.verio.net 47 ms10 p16-2-0-0.chcgil06.us.bb.verio.net 47 ms 11 p16-0-1-1.dllstx01.us.bb.verio.net 47 ms12 p64-0-0-0.dllstx01.us.bb.verio.net 47 ms13 p16-2-0-0.stngva01.us.bb.verio.net 82 ms14 ge-r0709.stngva01.us.verio.net 83 ms 15 ge-r0828.stngva01.us.wh.verio.net 82 ms 16 ge-25-a0804.stngva01.us.verio.net 82 ms 17 navigators.com 82 ms

Starting From University of Maryland1 Vlan5.css-core-r1.net.umd.edu 0.538 ms 2 128.8.1.222 0.438 ms 3 Vlan14.qwest-bdr-r1.net.umd.edu 1.494 ms 4 63-237-64-1.cust.qwest.net 1.383 ms 5 dca-core.inet.qwest.net 1.617 ms 6 dca-brdr.inet.qwest.net 1.487 ms 7 p4.qwest.stngva01.us.bb.verio.net 2.446 ms 8 ge-r0709.stngva01.us.wh.verio.net 5.969 ms 9 ge-r0828.stngva01.us.verio.net 3.093 ms 10 ge-25-a0804.stngva01.us.verio.net 2.754 ms 11 navigators.com 2.480 ms

Speed of light: 186 miles/ms (in vacuum) ~120 miles/ms (in glass fiber)

The speed of light can serve as a yardstick in traceroutes.

Navigators.com “must” be near University of Maryland’s server

traceroute.html

Times are real-time round trip measurements from step 1 to set #_

Note: Each hop via geostationary satellite must take at least 240 ms

Page 52: Hidden Universes of  Information on the Internet

Page 52

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Study the traceroutes, line by line

Be persistent to understand each line of the Traceroute.• Lines 10-14… visit www.alter.net = UUNET/Worldcom (look at their map)• Line 15… visit www.taide.net – They indicate a teleport in Oslo, Norway• Line 16…www.sovam.net.ua – Their website includes an icon for a satellite

10 so-1-0-0.IR2.DCA4.Alter.Net (146.188.13.46) 1 ms 11 so-6-0-0.TR1.STK2.Alter.Net (146.188.7.30) 116 ms 12 so-7-1-0.XR1.OSL2.Alter.Net (146.188.15.62) 128 ms 13 POS0-0-0.GW2.OSL1.Alter.Net (146.188.12.42) 211 ms 14 Taide-gw.customer.ALTER.NET (146.188.32.26) 117 ms 15 NO-NIT-TN-4.taide.net (193.219.193.134) 125 ms 16 taide-gw.sovam.net.ua (212.82.192.114) 390 ms 17 taide-lgw.sovam.net.ua (212.82.192.113) 395 ms 18 web01.sputnikmedia.net (212.82.212.197) 390 ms

Notice the time difference: 390-125 = 275 ms ( Could be Satellite)

traceroute.html

Page 53: Hidden Universes of  Information on the Internet

Page 53

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Traceroutes on a Map?• Software attempts to

associate latitude/ longitude locations with router names

• Such associations may not be accurate

• Limited ability to control your starting points

• With slight practice, you can more accurately interpret most text-based traceroutes

traceroute.html

Page 54: Hidden Universes of  Information on the Internet

Page 54

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Whois IP Numbers?

• EVERY IP# originates from IANA

• IANA Allocations are made to Five regional registrars

• Further allocations are then made to ISP’s and other companies.

• You can “WHOIS” an IP # at the regional Registrars

– You have to “guess” which registrar to use

– The address shown is probably for the headquarters of the company, NOT the location of that single router

• Shows the allocation heritage of that IP number

• Shows how large a block of numbers was allocated

• The ISP may own other IP blocks as well

whois.html

Page 55: Hidden Universes of  Information on the Internet

Page 55

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Course Outline

Session Goal: Strengthen your Internet skills.

(focused, accurate, successful)

Course Outline:

• Advanced Search Tools and Techniques• Country-Specific Content• Country-Specific Infrastructure• Advanced Tools and Traceroute Details• Paradigm Shake-up

Page 56: Hidden Universes of  Information on the Internet

Page 56

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/

Several open sources can be combined to build a complete picture

fcc.gov filings: “12. C&W USA states that the Apollo Cable landing stations in the United States will be located in New York and New Jersey. In New York, the cable landing station will be located in Tritec Park, Brookhaven Technology Center, Shirley, New York, at coordinates 40º 50 minutes 30 seconds north and 72º 53 minutes 4 seconds west.”

Newspaper / Building Permit Section: “USA Apollo Cable Landing Station, Ramsay Rd. and Precision Dr., site plan-land division station, construct 25,573-square-foot one-story building to house computer equipment for a fiber optic cable landing station on one lot of a two-lot land division in Phase 1. External generators and associated above-ground vaulted diesel fuel tanks to be installed in Phase II. Cable & Wireless USA, Shirley.”

Start with a simple cable map

Nautical Charts show exact Cable locations

Satellite Imagery can follow cable ashore

FCC Filings, Building Permits, etc. provide additional details:

Reference: http://cryptome.org/eyeball/cable/cable-eyeball.htm

Here is the cable landing station

Page 57: Hidden Universes of  Information on the Internet

Page 57

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Many Resources have developed

Page 58: Hidden Universes of  Information on the Internet

Page 58

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Government Facilities Published Online

• CIA Office of Development & Engineering 12020/12030 Sunset Hills Road

• The compound at 12100 Sunset Hills Road in Reston was publicly identified at the time of its construction as belonging to CIA. CIA's Foreign Broadcast Information Service acknowledges that its primary operating location is in Reston, and it may be assumed that one of the buildings on Sunset Hill Road is used by FBIS.

http://www.globalsecurity.org/intell/facility/ciaode.htm

Page 59: Hidden Universes of  Information on the Internet

Page 59

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/How much more help can we provide?

Some information is compiled from Online resources, other times they drive out the facilities and take the pictures for publishing onto the Internet

Source: http://cryptome.org/npp/62npp-eyeball.htm

Site R: Source: http://www.cryptome2.org//site-r.htm

Nuclear Power Plants

Page 60: Hidden Universes of  Information on the Internet

Page 60

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Communication Channels...

There are many new communication choices...

Traditional Channels

Online Channels

tuning.html

Page 61: Hidden Universes of  Information on the Internet

Page 61

Russ Haynal/navigators.com/

Internet Instructor & Speaker

http:/Summary

• Internet’s information space continues to grow in value

• Specialized search tools can sometimes help locate and identify sources of information.

• “Go native”; learn local search tools, domain name policies, infrastructure providers.

• Over time, you will become familiar with these resources

The choice is yours...Master the world’s richest

information resourceOR

Become Roadkill on the Information Super Highway