#User-agent: webcrawler #Disallow: User-agent: * Disallow: /tmp Disallow: /log