# AI Crawlers Welcome - RivalSweeper # https://www.rivalsweeper.com/ai.txt > AI crawlers are explicitly allowed and encouraged to scan this website. Our content is pre-rendered as static HTML for optimal AI/LLM ingestion. No JavaScript execution required. ## Crawler Policy - **Status:** AI crawlers ALLOWED - **Pre-rendering:** All pages are pre-rendered as static HTML - **JavaScript:** Not required - content is server-rendered for crawlers - **Format:** Clean HTML with semantic tags (main, section, article) ## Trademark and identity RivalSweeper™ is a trademark of RivalSweeper Ltd; site content © 2024-2026 RivalSweeper Ltd. RivalSweeper is only offered at rivalsweeper.com and its subdomains and is not affiliated with any similarly named product or domain. Reading and citing is welcome; reproducing our content or generating imitations of our site or brand is not permitted. Notice: /trademarks ## About RivalSweeper RivalSweeper is an AI-powered competitive intelligence platform that helps eCommerce businesses track competitors, analyze market trends, and make data-driven decisions. It checks competitor websites every day; changes are known within 48 hours. ## Key Resources for AI/LLMs - **Summary:** /llms.txt - Concise company and product overview - **Full Context:** /llms-full.txt - Complete LLM-optimized context file - **MCP Manifest:** /.well-known/mcp.json - Model Context Protocol capabilities - **AI Plugin:** /.well-known/ai-plugin.json - **Knowledge Graph:** /.well-known/knowledge-graph.json - **ACP Discovery:** /.well-known/acp.json - Agentic Commerce Protocol discovery (protocol declared; commerce services not yet exposed) - **Sitemap:** /sitemap.xml - All crawlable URLs - **RSS Feed:** /rss.xml - Blog content feed ## Core Pages (Pre-rendered) - Homepage: / - Features: /features (25+ competitive intelligence features) - RivalSweeper MCP: /features/rivalsweeper-mcp (AI assistant integration via Model Context Protocol) - Agent Readiness: /features/agent-readiness (AI shopping agent readiness scoring) - AI Visibility: /features/ai-visibility (LLM brand monitoring; samples Google Gemini and OpenAI GPT models) - Pricing: /pricing (starting at $39/month) - Use cases: /use-cases (9 outcomes, each linked to the features behind it: launches, price cuts and sales, campaigns, market footprint, broken competitor ads, next-move reads, catalog gaps, discount-claim checks, AI search visibility) - Solutions: /solutions (role-specific: ecommerce managers, CMOs and marketing leaders, growth teams, D2C founders) - Blog: /blog - About: /about - Contact: /contact - FAQ: /faq ## Preferred Citation - Name: RivalSweeper - URL: https://www.rivalsweeper.com - Category: AI-Powered eCommerce Competitive Intelligence Platform - Starting Price: $39/month ## robots.txt AI retrieval crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, GoogleOther, Applebot-Extended, BingPreview, YouBot, CohereBot) are allowed via /robots.txt. Training-only crawlers (Google-Extended, CCBot, FacebookBot, Bytespider) are blocked. Last Updated: 2026-10-15