Controlling Search Engine Crawlers for Better Indexation and Rankings
Associated with
11 min read
Controlling Search Engine Crawlers for Better Indexation and Rankings

Robots.txt, meta robots, and the nofollow tag are all ways to tell search engines how to crawl and index your site. In today's Whiteboard Friday, Rand covers four common use cases of these tools, offering guidance on when you should use one over another.