BotLens
BotLens is a free, open-source Chrome extension that analyzes how AI crawlers and language models perceive a website. It runs entirely in the browser, requiring no data collection or external servers. The extension fetches and parses robots.txt files, meta tags, semantic HTML, and JavaScript rendering to produce a 0–100 AI readability score with specific, actionable feedback. It checks if AI bots like GPTBot and ClaudeBot are allowed, validates heading hierarchy and structured data, and detects SPA shells that hide content from non-JavaScript crawlers. BotLens is ideal for developers, SEO specialists, and content creators who want to ensure their sites are accurately indexed and cited by generative AI systems.
- Category
- Bots
- Pricing
- Free
Problem solved
Many websites unknowingly block or poorly serve AI crawlers due to misconfigured robots.txt, missing semantic markup, or JavaScript-rendered content that traditional bots cannot execute. BotLens instantly audits these factors and provides a clear readability score and remediation steps, helping site owners optimize for Generative Engine Optimization (GEO).
Use cases
- Audit a website's AI crawler access rules in seconds
- Check if AI bots like GPTBot or ClaudeBot are blocked via robots.txt
- Validate heading hierarchy and HTML5 landmarks for LLM readability
- Detect single-page application (SPA) shells that hide content from non-JavaScript crawlers
- Verify presence of noai and noimageai meta directives for AI training opt-out
- Improve generative engine optimization (GEO) to increase citation chances in ChatGPT or Perplexity
Audience
- Developers
- Business Users
- Content Creators
- Product Managers
Pros
- Fully client-side analysis – no data leaves the browser
- Free and open source under MIT license
- Recognizes over 20 AI-specific user agents
- Instant weighted score with plain-language verdict and fix suggestions
- Detects JavaScript-rendered content gaps that traditional SEO tools miss
Cons
- Only available for Chromium-based browsers (Chrome, Edge, Brave, etc.)
- Limited to single-page audits; no built-in site-wide crawling
- Does not simulate actual LLM reading or guarantee improved citations
- No integration with external SEO platforms or APIs
- Score does not account for content quality or relevance
Official website: https://botlens.iamjarl.com/
Canonical LambdaBase page: https://www.lambdabase.com/tools/botlens