# /robots.txt file for http://www.specfactory.co.za # /all robots are allowed to crawl any part of specfactory.co.za EXCEPT all relative URLs & files starting with Disallow: / always put / on end of line User-agent: * Disallow: /siteadmin/ Disallow: /phptell/ Disallow: /java_cook_files/ Disallow: /cgi-bin/ Disallow: /pri_phpadmin/ Disallow: /test/ Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /image/ Disallow: /images/ Disallow: /test2/ Disallow: /newsletter/ Disallow: /test_old/ Disallow: /SEO/ Disallow: /old files/ Disallow: /java_cook_files/ Disallow: /pri_phpadmin_blockedoutt/ Disallow: /newsletter/ Disallow: /css/ Disallow: /fonts/ Disallow: /inc/ Disallow: /_notes/ Disallow: /changes/ Disallow: /swf/ Disallow: /TMP5t8pii2tn2/ Sitemap: http://specfactory.co.za/sitemap.xml