User-agent: * # directed to all spiders, not just Scooter Disallow: /bin/ Disallow: /dev/ Disallow: /etc/ Disallow: /pub/ Disallow: /sbin/ Disallow: /stats/ Disallow: /tmp/ Disallow: /usr/ Disallow: /media/ Disallow: /francais/frames/