# Motion Text — https://motiontext.video # AI crawlers are explicitly welcome; see /llms.txt for a machine-readable # overview and the MCP server for programmatic authoring. # # A named group REPLACES the wildcard group for that agent — it does not add to # it. Every block therefore repeats the Disallow lines; without them, naming a # crawler to welcome it also invited it into /admin and /account. # # The OpenAI crawlers do different jobs and are granted separately: # OAI-SearchBot builds the index ChatGPT Search cites. This is the one that # decides whether we can appear as a source in an answer. # ChatGPT-User fetches a page live when a person or a Custom GPT follows a # link. OpenAI notes robots.txt may not apply to it, being # user-initiated; listed anyway so the intent is unambiguous. # GPTBot training crawler. Allowed deliberately: a model that has read # the docs is a model that can recommend the product. User-agent: * Disallow: /account Disallow: /admin Disallow: /login Disallow: /signup Allow: / User-agent: OAI-SearchBot Disallow: /account Disallow: /admin Disallow: /login Disallow: /signup Allow: / User-agent: ChatGPT-User Disallow: /account Disallow: /admin Disallow: /login Disallow: /signup Allow: / User-agent: GPTBot Disallow: /account Disallow: /admin Disallow: /login Disallow: /signup Allow: / User-agent: ClaudeBot Disallow: /account Disallow: /admin Disallow: /login Disallow: /signup Allow: / User-agent: Claude-Web Disallow: /account Disallow: /admin Disallow: /login Disallow: /signup Allow: / User-agent: Claude-SearchBot Disallow: /account Disallow: /admin Disallow: /login Disallow: /signup Allow: / User-agent: PerplexityBot Disallow: /account Disallow: /admin Disallow: /login Disallow: /signup Allow: / User-agent: Google-Extended Disallow: /account Disallow: /admin Disallow: /login Disallow: /signup Allow: / Sitemap: https://motiontext.video/sitemap.xml