how big is the internet? as of 2005, internet size is estimated at 5 million terabytes: 5
TRANSCRIPT
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
5
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
50
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
500
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
5,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
50,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
500,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
5,000,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
50,000,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
500,000,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
5,000,000,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
50,000,000,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
500,000,000,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
5,000,000,000,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
50,000,000,000,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
500,000,000,000,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
5,000,000,000,000,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
50,000,000,000,000,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes:
500,000,000,000,000,000
HOW BIG IS THE INTERNET?
As of 2005, Internet size is estimated at 5 million terabytes (or 5 Trillion Megabytes):
5,000,000,000,000,000,000
At the end of 2008, it was estimated to exceed a petabyte (1000x a terabyte)
• 10 million new pages published daily
• Best search engines index 1 million pages per day
• Internet growing 10 times faster than we can index it!
• If Google continues to index as fast as it can, it would take 300 years to index the current internet - - without any more additions!
• Google estimates it has indexed .004% of the internet
HOW BIG IS THE INTERNET?
Who uses the internet?
• 1.46 billion unique people use the internet daily -23% of the world.
• World population is a little over 6 billion so 1/6th of the world is using the internet each day.
Everyone assumes internet searching is easy.
It is not!
It is so big, the real problem is getting too many 'hits
WHAT ARE SEARCH ENGINES?
Types:
• INDIVIDUAL
• METASEARCHERS
WHAT ARE SEARCH ENGINES?
Types:
• INDIVIDUAL - make their own searchable databases on the web
• METASEARCHERS
WHAT ARE SEARCH ENGINES?
Types:
• INDIVIDUAL - make their own searchable databases on the web
• METASEARCHERS - search multiple individual engines
Clusty.com (no google / yahoo) Dogpile.com (includes google)
HOW DO SEARCH ENGINES WORK?
• VISIBLE WEB:
• INVISIBLE WEB:
HOW DO SEARCH ENGINES WORK?
• VISIBLE WEB:
Use “spiders” or “robots” (“bots”) to crawl thru web space from link to link to look at pages
• INVISIBLE WEB:
Sites with no links to other pages (no “spider food”) can be missed altogether
HOW TIMELY IS INTERNET RESOURCES?
• How much earlier?
• A site has to be spidered AND indexed to find it thru a search engine
• NOTE: Search engines partner with specialized news databases to give you current info
• A Search engine is the only way to find information published on the web
• Many results will be irrelevant to what you want.
SURPRISE! You are NOT searching the entire web as it exists at this moment
You get a portion of web captured at an earlier date
ARE ALL SEARCH ENGINES THE SAME?
• Search speed varies• Size on search content varies• Search engine overlap is about 60%.• 40% of search results are unique• Results ranked on publisher’s “Klout” score
– Blogging, Tweeting, Facebook Likes, Linked In, Frequency of web updates, website links, Followers, Wikipedia Mentions
How Good Are Search Results?
• Relevance Rankings – schemes are TOP SECRET
• In last 2 years things have changed!– Every click on an internet link adds to our “on-
line profile”– Intent to help us sift thru information overload– Search results relies more heavily on our on-
line history than objectiveness
Invisible Editing of the Web• What are our most trusted site visits?
– Websites we visit everyday– Links from our friends
• Customized ads / shopping ideas from Amazon, Netflix, etc. differ from research
• Narrowing instead of broadening
• Difference between what we WANT to see and what we NEED to see
• Searchers rarely go past page 2 results
ARE ALL SEARCH ENGINES THE SAME?
Every search engine creates it’s own “haystack” of information. If you can’t find your “needle” in one haystack, go
to another.