# robots.txt - crawler configuration file User-agent: * Disallow: /admin/ Disallow: /database/ Disallow: /login.asp Sitemap: http://www.tasinternational.com.au/sitemap.xml