#Tells search robots which directories not to look in. # # Which robots ("*"=all) User-agent: EmailSiphon Disallow: / User-agent: libwww-perl/5.* Disallow: / User-agent: NEWT Disallow: / User-agent: Crescent* Disallow: / User-agent: * Disallow: /Journals Disallow: /badspammer.html Disallow: /id.html Disallow: /redirect.html Disallow: /test.html Disallow: /manual/ Disallow: /stats/ Disallow: /stats2/ Disallow: /cgi-bin/ Disallow: /Flybrain/review/ Disallow: /Flybrain/bin/ Disallow: /Flybrain/.desktop-web/ Disallow: /Flybrain/html/toolbar/ Disallow: /Flybrain/bnchmrk/ Disallow: /Flybrain/html/gifs/ Disallow: /Flybrain/html/images/ Disallow: /Flybrain/tmp/