# Allow all crawlers User-agent: * Allow: / # Disallow private and internal routes Disallow: /api/ Disallow: /result/ Disallow: /dashboard/ Disallow: /auth/ Disallow: /hire/ # Sitemap location Sitemap: https://htpbe.tech/sitemap.xml