User-agent: * Disallow: # allow all robots # Disallow: / # disallow all robots