# Allow all bots to crawl everything except specific admin/system folders User-agent: * # Allow specific files inside restricted folders # Block search engines from specific file types Disallow: /*.inc$ Disallow: /*.sql$ User-agent: * Disallow: /search/ User-agent: ClaudeBot Disallow: / User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: Bytespider Disallow: / User-agent: Amazonbot Disallow: / User-agent: Amzn-SearchBot Disallow: / User-agent: amazon-kendra-web-crawler Disallow: / # Point bots to your XML Sitemap Sitemap: https://www.ownzee.com.com/sitemap.xml