AI Agents Overview
How Crawltable's integrated agents help you analyze data and surface insights.
Crawltable includes AI agents that work directly with your crawl data. Instead of exporting to a spreadsheet and analyzing manually, you can ask an agent to do it for you.
What agents can do
Agents have full access to your crawl dataset. They can:
- Filter and sort — "Show me all pages with a missing meta description and more than 1,000 words"
- Analyze patterns — "Which URL paths have the highest average GEO score?"
- Spot issues — "Find pages that are indexed but return a 404 when crawled"
- Summarize — "Give me a high-level overview of the technical health of this site"
- Compare — "What changed between last week's crawl and today's?"
You interact with agents through a natural language chat interface. Type a question or instruction, and the agent responds with analysis, tables, or visualizations pulled from your data.
How agents work
Under the hood, agents translate your natural language requests into structured queries against your crawl data. They can:
- Apply column filters and sorting
- Aggregate and group data
- Cross-reference multiple data points
- Generate summary statistics
The agent sees the same data you see in the crawl table — no data leaves your machine.
Best practices
- Be specific. "Show me pages with thin content" is good. "Show me pages under 200 words that target high-volume keywords" is better.
- Iterate. Start with a broad question, then narrow down based on what the agent finds.
- Use agents for exploration. They're great for the initial "what's going on with this site?" phase of an audit.
Limitations
Agents work with the data from your most recent crawl. They don't have access to external data sources (like Google Analytics) unless you've connected an integration. They also can't modify your data — they're read-only analysts.