organic search. crawl index rank crawling known web pages index servers crawler machines crawler...
Post on 19-Dec-2015
217 views
TRANSCRIPT
![Page 1: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/1.jpg)
ORGANIC SEARCH
![Page 2: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/2.jpg)
CRAWL
INDEX
RANK
![Page 3: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/3.jpg)
CRAWLING
KnownWeb
pages
Index Servers
CrawlerMachines
Googlebot
Doc Servers
![Page 4: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/4.jpg)
DEVELOPING THE LIST OF KNOWN WEB PAGES
KnownWeb
pages
Prior Crawls
/addurl
![Page 5: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/5.jpg)
PEREMECH
![Page 6: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/6.jpg)
CRAWLING FOR PEREMECH
usm.maine.edu/index.html
/academic/index.html
/sb/index.html
/sb/facultystaff.html
/sb/zsuleiman.html
/~suleiman/index.html
/~suleiman/peremech/index.html
other linked pages
other linked pages
other linked pages
![Page 7: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/7.jpg)
CRAWLERS IDENTIFY THEMSELVES
![Page 8: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/8.jpg)
ROBOTS.TXT – EXCLUDES SITES FROM CRAWLING
whitehouse.gov/robots.txt
![Page 9: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/9.jpg)
CRAWLERS SHOULD NOT HOG RESOURCES
![Page 10: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/10.jpg)
CRAWLING PROBLEM: THE WEB IS VAST
![Page 11: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/11.jpg)
CRAWLING PROBLEM: THE HIDDEN WEB
![Page 12: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/12.jpg)
INDEXING
![Page 13: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/13.jpg)
RANKING
Closely guarded, proprietary algorithm
![Page 14: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/14.jpg)
RANKING
Organic Search Results
Keyword Phrase
![Page 16: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/16.jpg)
WHY IS RED LOBSTER RANKED HIGHER?
Can you find the word Lobster?
![Page 17: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/17.jpg)
HOW CAN I IMPROVE MY RANK?
![Page 18: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/18.jpg)
BASIC SEO CONCEPTS –TEXT
KEYWORD PROXIMITY
We sell live Maine lobster
Home of Maine’s best lobster
All of our lobsters come from Maine
![Page 19: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/19.jpg)
BASIC SEO CONCEPTS –TEXT
KEYWORD DENSITY
What percentage of the words on this page are lobster.
![Page 20: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/20.jpg)
BASIC SEO CONCEPTS –TEXT
KEYWORD FREQUENCY
The keyword lobster is visible 32 times and occurs 182 times on the page
![Page 21: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/21.jpg)
BASIC SEO CONCEPTS –TEXT
KEYWORD PROMINENCE
LobsterLobster
Lobster
Lobster
Lobster
Lobster
![Page 22: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/22.jpg)
BASIC SEO CONCEPTS – LINKING
LINK EXCHANGE AND PAID PLACEMENT
![Page 23: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/23.jpg)
BASIC SEO CONCEPTS – LINKING
An article written at thefreelibrary.com
![Page 24: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/24.jpg)
BASIC SEO CONCEPTS – LINKING
PAID PLACEMENT
![Page 25: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/25.jpg)
BASIC SEO CONCEPTS – LINKING
LINK EXCHANGE - RELEVANT
![Page 26: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/26.jpg)
BASIC SEO CONCEPTS – LINKING
LINK EXCHANGE – NON RELEVANT
![Page 27: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/27.jpg)
BASIC SEO CONCEPTS – LINKING
LINK SPAM
![Page 28: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/28.jpg)
BASIC SEO CONCEPTS – LINKING
COMMENT/ FORUM SPAM
![Page 29: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/29.jpg)
BASIC SEO CONCEPTS – LINKING
COMMENT/ FORUM SPAM
![Page 30: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/30.jpg)
LINK EXCHANGE IS CONTROVERSIAL
![Page 31: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/31.jpg)
USER RELEVANCE
LOCATION
USER ID
130.111.115.24
![Page 32: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/32.jpg)
USER EXPERTISE VARIES
![Page 33: ORGANIC SEARCH. CRAWL INDEX RANK CRAWLING Known Web pages Index Servers Crawler Machines Crawler Machines Googlebot Doc Servers](https://reader036.vdocument.in/reader036/viewer/2022062516/56649d2d5503460f94a030a1/html5/thumbnails/33.jpg)
PHOTO ATTRIBUTIONS
Slide 10: 'OINK! OINK!’ www.flickr.com/photos/49968232@N00/51679641
Slide 11: ‘The Vast Web’ wikicommons.com
Slide 13: 'Royal Guards’ www.flickr.com/photos/23697065@N05/2356109302
Slide 17: 'Yoda (IMG_3308)‘ www.flickr.com/photos/73531322@N00/194828922
Slide 30: ‘Vera Cruz’ BAM/Photofest