Agent analytics in real time
Shows real-time activity from crawlers, scrapers, and AI agents so you can see which bots visit your site, which pages they hit, and how traffic changes over time.
Known Agents
Known Agents helps website owners track AI agents and bots, measure referrals from AI chat platforms, and control access with robots.txt updates, bot blocking, and agent verification. It supports WordPress, CDN, cloud, and backend/API integrations.
What Known Agents does
Known Agents is a website analytics and control product focused on AI agents, crawlers, scrapers, and other bots. It gives site owners a way to see this traffic in real time, measure referrals from AI chat platforms, and apply rules that control how different agents can access their content.
The product combines observability and enforcement in one workflow. You can track bot visits, follow individual agent sessions, update robots.txt automatically, block misbehaving bots, and verify agent identity through an API for access-control use cases such as licensed content.
Core capabilities
LLM referral tracking
Measures citations and human referrals from AI chat and search platforms such as ChatGPT, Claude, and Gemini, giving you a way to evaluate AI-driven discovery.
Automatic robots.txt
Serves a continuously updated robots.txt that groups bots by category and reflects newly discovered agents without manual edits.
Bad bot detection and blocking
Detects misbehaving or spoofed bots and can block them with the WordPress plugin or WAF-based rules, including automation-tool based scrapers.
Agent identification API
Verifies agent identity from your own code with an API based on Web Bot Auth, which can be used to gate access to licensed content.
Multiple integration paths
Supports connection through WordPress, major CDNs, cloud platforms, or backend code, so teams can adopt it without rebuilding their site architecture.
Common ways to use Known Agents
Monitor hidden bot traffic
Use real-time bot visibility to understand which crawlers and AI agents are visiting your site, how often they come back, and which pages they target.
Measure AI-driven discovery for publishers
Publishers can track citations and referrals from AI chat platforms, then use that data to see which content is being surfaced and where humans click through.
Reduce manual crawl-control work
Teams can automatically maintain robots.txt rules for entire bot categories and block misbehaving scrapers through existing enforcement tools.
Gate access to licensed content
Sites that license content can verify agent identity before allowing access, using the API and Web Bot Auth flow to support access policies.
Observe AI shopping and MCP journeys
Commerce or product teams can monitor agentic traffic to MCP or shopping endpoints and study how AI shopping flows affect discovery and conversion paths.
Pros and Cons
Pros
- Covers both visibility and control, instead of only reporting bot activity.
- Offers multiple integration options, including WordPress, CDN, cloud, and backend/API paths.
- Tracks AI chat referrals as well as crawler traffic, which helps connect bot activity to downstream human visits.
- Provides automated robots.txt updates and bot blocking tools that reduce manual maintenance.
- Includes a free self-serve starting point, with paid plans available as usage grows.
Cons
- The source does not spell out every limitation of the platform, so some setup details may depend on the integration path you choose.
- The pricing page shows usage-based event limits and tiering, which means heavier traffic may require plan changes.
FAQ
How do you connect a website to Known Agents?
Yes. The docs show setup options for WordPress, Cloudflare, Fastly, Akamai, AWS, Google Cloud, Node.js, Python, PHP, and a REST API for other backends. The product also says it can be connected through your CDN, WordPress plugin, or API.
Who is Known Agents for?
Known Agents is built for website owners who want visibility into AI agents, crawlers, scrapers, and LLM referrals. The publishers FAQ says it is useful for publishers, and the pricing page shows plans for individuals, startups, enterprises, and large businesses.
What does Known Agents output or help you do?
The platform combines agent analytics, LLM referral tracking, automatic robots.txt updates, bad bot detection, and an agent identification API. The publisher FAQ also says it can help protect content, cut server costs, and document crawling for licensing conversations.
What plans does Known Agents offer?
The source describes a free self-serve plan, paid Individual and Startup plans, and a custom Enterprise plan. It also says the free plan has a hard event limit, while paid plans use tiered event usage.
Can multiple teammates use it?
The source does not describe a single supported team workflow in detail, but it does say you can invite teammates on some plans and that the platform works alongside existing CDNs and other tools.
Quick Facts
- Category
- AI agent and bot analytics
- Source domain
- knownagents.com
- Primary users
- Website owners, publishers, and businesses managing bot traffic
- Pricing model
- Free plan, paid self-serve plans, and custom enterprise pricing
- Integrations
- WordPress, CDN, cloud platforms, backend code, and REST API
- Notable workflow
- Track bot traffic, track AI referrals, update robots.txt, block bad bots, and verify agents
Альтернативы Known Agents
Benchspan
Benchspan is an AI agent security platform that discovers agents, blocks prompt injection and data exfiltration in real time, and supports pre-launch red teaming. It is aimed at teams running agents in production and includes Python and TypeScript SDKs.
PromptScout
PromptScout tracks how ChatGPT, Gemini, Google AI Overviews, and Perplexity mention your brand or competitors, then pairs those results with source analysis and website audits. It helps teams decide what to fix in content, positioning, or site readiness next.
Lasso
Lasso is an ecommerce product data platform for enriching catalog records, processing supplier files, generating product content, and monitoring competitors. It combines a web app with a REST API, SDK, and MCP server for teams and developers.
Sleek Analytics
Sleek Analytics is a privacy-friendly web analytics tool with real-time visitor tracking, Core Web Vitals, and revenue attribution. It helps site owners understand traffic and conversions without cookie banners or a heavy setup.
MacSpoof
MacSpoof — смена MAC-адреса в macOS: меняйте или рандомизируйте Wi‑Fi MAC, чтобы переподключаться и меньше светить идентификатор в публичных сетях.
Botacts
Botacts is a web directory for finding AI bots and agents you can contact by phone, email, SMS, WhatsApp, Telegram, or Signal. It also lets creators suggest bots for manual review before publication.