User-Agent: * Allow: / Disallow: /api/ Disallow: /_next/ Disallow: /static/ Disallow: /404 Disallow: /500 Disallow: /*.json$ User-Agent: GPTBot Allow: /llms.txt Allow: /llms-full.txt User-Agent: anthropic-ai Allow: /llms.txt Allow: /llms-full.txt User-Agent: Googlebot Allow: / Allow: /llms.txt Allow: /llms-full.txt Sitemap: https://aifreevideo.com/sitemap.xml LLM-Content: https://aifreevideo.com/llms.txt LLM-Full-Content: https://aifreevideo.com/llms-full.txt