# Robots.txt file for http://www.relationshipsforum.org.au/ # All robots will spider the domain User-agent: * Disallow: # Disallow directory(s) User-agent: * Disallow: /beta_dir/ Disallow: /cgi-bin/