Download - Large Scale SEO - Method to the madness
![Page 1: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/1.jpg)
Method to the madness - Large Scale SEO
![Page 2: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/2.jpg)
![Page 3: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/3.jpg)
What’s the problem?
![Page 4: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/4.jpg)
Homepage example.com/
Support portal kb.example.com
Shop example.com/shop/
News section example.com/news/
A “modern” website:
Community portal example.com/forums/
![Page 5: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/5.jpg)
What could go wrong?• Support portal outranking the main website
• An error in the shop software causing the entire site to stop being indexed
• So much crawl budget being spent on community forums that shop doesn’t get crawled properly
• KB linking to shop everywhere, shop changes URL structure
• etc. etc. etc.
![Page 6: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/6.jpg)
![Page 7: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/7.jpg)
What’s the solution?
![Page 8: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/8.jpg)
Modern websites cause a need for a different SEO
approach.
![Page 9: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/9.jpg)
Method• Build properly
• Get all the needed data
• Optimize constantly
• Audit regularly
• Teach others
![Page 10: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/10.jpg)
Do you know what’s on your site?
![Page 11: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/11.jpg)
![Page 12: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/12.jpg)
![Page 13: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/13.jpg)
Homepage example.com/
Support portal kb.example.com
Shop example.com/shop/
News section example.com/news/
It can be as simple as this:
Community portal example.com/forums/
![Page 14: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/14.jpg)
![Page 15: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/15.jpg)
Method• Build properly
• Get all the needed data
• Optimize constantly
• Audit regularly
• Teach others
![Page 16: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/16.jpg)
A comprehensive SEO data strategy• Service Oriented Approach to main sources of
information:
• Analytics
• Logs, specifically:
• Spider logs
• Error logs
• Internal Search
![Page 17: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/17.jpg)
Analytics
![Page 18: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/18.jpg)
Analytics• Often the only thing that’s already centralized.
• Far too often answers questions that you don’t need to answer.
![Page 19: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/19.jpg)
Do you know what content on your site is
the most engaging?
![Page 20: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/20.jpg)
Facebook stats?
![Page 21: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/21.jpg)
Twitter stats?
![Page 22: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/22.jpg)
Pinterest?
![Page 23: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/23.jpg)
Video?
![Page 24: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/24.jpg)
This can be done.
![Page 25: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/25.jpg)
Engagement metrics
![Page 26: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/26.jpg)
Engagement metrics
![Page 27: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/27.jpg)
Good analytics is an aggegration of loads of
sources of data.
![Page 28: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/28.jpg)
Logs & Search console
![Page 29: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/29.jpg)
Googlebot stats before GSC tells youDo you need Google Search Console to tell you you’ve got errors on your site?
![Page 30: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/30.jpg)
LogsCentralize all logs into one “stash”.
My personal preference: Logstash on ElasticSearsch.
Using Kibana, you can filter out and create specific dashboards for bot traffic and errors.
![Page 31: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/31.jpg)
Googlebot stats that HELP
![Page 32: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/32.jpg)
Some of my favorite viewsTop spidered URLs over the last 24 hours, by Google user agent.
Average response time, slow loading pages, slow loading page types.
Googlebot 4xx and 5xx errors over the last 24 hours.
![Page 33: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/33.jpg)
Google Search Console errorsBe honest, how many of you have “accepted” a “background noise” of thousands or even 100k+ errors?
![Page 34: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/34.jpg)
![Page 35: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/35.jpg)
User errorsIs anybody at your company monitoring user “crashes”? Pages that 404 more than X times a day?
![Page 36: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/36.jpg)
If engagement is king, errors are the
hangman.
![Page 37: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/37.jpg)
Internal Search
Internal search
![Page 38: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/38.jpg)
Internal search should tell you which content
you have.
![Page 39: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/39.jpg)
Internal Search monitoring• Is someone / something monitoring the missed
keyword opportunities across your site?
• This could flow back into ElasticSearch / Kibana too
![Page 40: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/40.jpg)
URLs
![Page 41: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/41.jpg)
Homepage example.com/
Support portal kb.example.com
Shop example.com/shop/
News section example.com/news/
A link changes in your shop
Community portal example.com/forums/
![Page 42: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/42.jpg)
Homepage example.com/
Support portal kb.example.com
Shop example.com/shop/
News section example.com/news/
What happens to the links pointing there?
Community portal example.com/forums/
![Page 43: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/43.jpg)
URLs and links across your site• In an ideal world, you never embed complete links.
• You embed ID’s, which are translated to links based on one datasource.
![Page 44: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/44.jpg)
Homepage example.com/
Support portal kb.example.com
Shop example.com/shop/
News section example.com/news/
One database that has all the URLs for:
Community portal example.com/forums/
![Page 45: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/45.jpg)
All URLs• App deeplinks
• hreflang relations
• AMP URLs
• etc. etc.
![Page 46: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/46.jpg)
XML Sitemaps & hreflang
![Page 47: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/47.jpg)
Homepage example.com/
Support portal kb.example.com
Shop example.com/shop/
News section example.com/news/
You probably don’t have this:
Community portal example.com/forums/
![Page 48: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/48.jpg)
Homepage example.com/
Support portal kb.example.com
Shop example.com/shop/
News section example.com/news/
Community portal example.com/forums/
Homepage example.com/
Support portal kb.example.com
Shop example.com/shop/
News section example.com/news/
Community portal example.com/forums/
Homepage example.com/
Support portal kb.example.com
Shop example.com/shop/
News section example.com/news/
Community portal example.com/forums/
Homepage example.com/
Support portal kb.example.com
Shop example.com/shop/
News section example.com/news/
But this, in 4, 5, 8, 20 languages:
Community portal example.com/forums/
![Page 49: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/49.jpg)
Multiple Sitemap indexes• Don’t try to combine them!
![Page 50: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/50.jpg)
Need to build XML sitemaps?• Base it off of your Internal Search API!
• Use a smart naming scheme to help you dive into sections of your site easily.
![Page 51: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/51.jpg)
Method• Build properly
• Get all the needed data
• Optimize constantly
• Audit regularly
• Teach others
![Page 52: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/52.jpg)
Use your internal search API for related content.
![Page 53: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/53.jpg)
Feed engagement and commercial metrics in.
![Page 54: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/54.jpg)
Method• Build properly
• Get all the needed data
• Optimize constantly
• Audit regularly
• Teach others
![Page 55: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/55.jpg)
Site changes? Embed SEO into CI• Who knows what CI is?
![Page 56: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/56.jpg)
Create CI tests for important stuff• Check canonicals
• Check hreflang
• Check that URLs stay the same
• Check HTTP header codes
• etc.
![Page 57: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/57.jpg)
Regular crawls to identify issues• Screaming Frog, OnPage.org, DeepCrawl, etc.
• I don’t care which one you use, as long as you one.
![Page 59: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/59.jpg)
Method• Build properly
• Get all the needed data
• Optimize constantly
• Audit regularly
• Teach others
![Page 60: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/60.jpg)
Teach developers technical SEO.
![Page 61: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/61.jpg)
Teach analytics people to look beyond your
main analytics package.
![Page 62: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/62.jpg)
Teach!
![Page 63: Large Scale SEO - Method to the madness](https://reader031.vdocument.in/reader031/viewer/2022021921/58f9b31f760da3da068bd2a6/html5/thumbnails/63.jpg)
Questions?Follow along:
• https://yoast.com/
• @jdevalk & @yoast on Twitter
• facebook.com/yoast