User-agent: ia_archiver
Disallow: /

User-agent: *
Allow: /
Crawl-delay: 5


Sitemap: http://pubdist.co.nz/sitemap.xml