Cockroach Crawler is a governed web acquisition and extraction layer for AI agents. It supports bounded public-web crawling, searchable site maps, robots handling, JavaScript rendering, readable text and Markdown, JSON and JSONL, structured fields, CSS, XPath, restricted-regex...
Cost / License
- Free
- Open Source (MIT)
Application type
Platforms
- Linux
- Windows
- Mac






































































