Crawling smarter, not harder

Search Off the Record

Content provided by Google Developer Studio. All podcast content including episodes, graphics, and podcast descriptions are uploaded and provided directly by Google Developer Studio or their podcast platform partner. If you believe someone is using your copyrighted work without your permission, you can follow the process outlined here https://player.fm/legal.

1M ago 40:11

MP3•Episode home

In this episode of SOTR, John Mueller, Lizzi Sassman, and Gary Illyes talk about misconceptions around crawl frequency and site quality, what's challenging about crawling the web nowadays, and how search engines could crawl more efficiently.

Resources: Episode transcript → https://goo.gle/sotr079-transcript Gary's post on LinkedIn → https://goo.gle/3YAT55q Crawling episode with Dave Smart → https://goo.gle/3WShUsf If-Modified-Since → https://goo.gle/3ywXvja About the IETF → https://goo.gle/3SGVVlo Robots Exclusion Protocol → https://goo.gle/4dgmBSg Proposal for new kind of chunked transfer → https://goo.gle/3AgMF1c

Listen to more Search Off the Record → https://goo.gle/sotr-yt Subscribe to Google Search Channel → https://goo.gle/SearchCentral

Search Off the Record is a podcast series that takes you behind the scenes of Google Search with the Search Relations team.

#SOTRpodcast

156 episodes

#Tech #Googlesearch #Googlesearchofftherecord #Googlesearchpodcast #Googlewebmasterspodcast #Searchengineoptimization #Searchofftherecord #Searchofftherecordpodcast #Google Developer Studio #Googlesearchcentral #SEO