# these robots have been bad once: user-agent: stress-agent Disallow: / User-agent: fast Disallow: / User-agent: Scooter Disallow: / # User-agent: ia_archiver # Disallow: /