News:

Welcome to the Unofficial Help Forum



Author Topic: google ignored (robots)  (Read 3080 times)

Offline shubh

  • Jr. Member
  • *
  • Posts: 52
    • View Profile
google ignored (robots)
« on: May 29, 2012, 09:22:29 AM »
Google ignored this in robots.txt

Quote
Crawl-delay: 5 

  Rule ignored by Googlebot
No words left

Offline Illori

  • Administrator
  • *
  • Posts: 324
    • View Profile
Re: google ignored (robots)
« Reply #1 on: May 30, 2012, 05:58:37 AM »
looks like google does not follow that. you need to read http://support.google.com/webmasters/bin/answer.py?hl=en&answer=48620