User-agent: * # directed to all spiders Disallow: /admin/ Disallow: /c/ Disallow: /cgi-bin/ Disallow: /demo/ Disallow: /guest/ Disallow: /hold_pages/ Disallow: /php/ Disallow: /stats/ Disallow: /stats_OLD/ Disallow: /webstats/ Disallow: /wwwboard/