Artwork

Content provided by Google Developer Studio. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Google Developer Studio or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.
Player FM - Podcast App
Go offline with the Player FM app!

What is a web crawler, really?

30:05
 
Share
 

Manage episode 406409662 series 2684037
Content provided by Google Developer Studio. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Google Developer Studio or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

In this episode of Search Off the Record, Gary Illyes and Lizzi Sassman take a deep dive into crawling the web: what is a web crawler, and how does it really work? Listen along as the Search team is joined by an expert web developer in the SEO community, Dave Smart, for an in-depth and technical discussion of all things crawling, and maybe dispel some myths along the way.

Resources:

Episode transcript → https://goo.gle/sotr070-transcript

Managing your crawl budget → https://goo.gle/3IzRZxl

Dave Smart on LinkedIn → https://goo.gle/3wPSuRA

Tame the Bots → https://goo.gle/4cfCQ1P

Search Central Help Forum → https://goo.gle/sc-forum

Indexing API docs → https://goo.gle/3v8yVU0

Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.

#SOTRpodcast

Speaker: Gary Illyes, Lizzi Sassman

Products Mentioned: Search Off The Record

  continue reading

124 episodes

Artwork

What is a web crawler, really?

Search Off the Record

46 subscribers

published

iconShare
 
Manage episode 406409662 series 2684037
Content provided by Google Developer Studio. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Google Developer Studio or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

In this episode of Search Off the Record, Gary Illyes and Lizzi Sassman take a deep dive into crawling the web: what is a web crawler, and how does it really work? Listen along as the Search team is joined by an expert web developer in the SEO community, Dave Smart, for an in-depth and technical discussion of all things crawling, and maybe dispel some myths along the way.

Resources:

Episode transcript → https://goo.gle/sotr070-transcript

Managing your crawl budget → https://goo.gle/3IzRZxl

Dave Smart on LinkedIn → https://goo.gle/3wPSuRA

Tame the Bots → https://goo.gle/4cfCQ1P

Search Central Help Forum → https://goo.gle/sc-forum

Indexing API docs → https://goo.gle/3v8yVU0

Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.

#SOTRpodcast

Speaker: Gary Illyes, Lizzi Sassman

Products Mentioned: Search Off The Record

  continue reading

124 episodes

All episodes

×
 
Loading …

Welcome to Player FM!

Player FM is scanning the web for high-quality podcasts for you to enjoy right now. It's the best podcast app and works on Android, iPhone, and the web. Signup to sync subscriptions across devices.

 

Quick Reference Guide