User-agent: * Disallow: /admin/ Disallow: /account/ Disallow: /checkout/ Disallow: /api/ # /api/ itself is the public API docs page, and it is in the sitemap. Allow: /api/$ # Account / auth / billing flows - private, no SEO value. The login and # signup forms are NOT listed: they carry X-Robots-Tag noindex, which Google # can only read if it may fetch the page. Disallow: /logout/ Disallow: /success/ Disallow: /cancel/ Disallow: /verify/ Disallow: /delete-account/ # Crawl traps: language-chooser links carry ?return=, login flows ?next=, and # thin internal search / re-order pages use ?q= / ?sort=. ?lang= stays # crawlable so Google can read the noindex on unproofed languages. Disallow: /*?return= Disallow: /*?next= Disallow: /*?q= Disallow: /*?sort= Disallow: /*?ref= Disallow: /*?from= Sitemap: https://firstemployee.ai/sitemap.xml