# Roxen Crawler knows what to do. User-agent: RoxenCrawler/1.0 Disallow: User-agent: * Disallow: Disallow: /_dev/ Disallow: /_han/ Disallow: /_maintenance/ Disallow: /distrib/ Disallow: /lib/ Disallow: /extra-files/