I saw a site the other day have this directive in their robots.txt file:
What does a blank "disallow" in this situation mean (ie. with no path/file listed)?
I'm guessing it is basically a nonsensical directive?
User-agent: Googlebot
Disallow:
What does a blank "disallow" in this situation mean (ie. with no path/file listed)?
I'm guessing it is basically a nonsensical directive?