Crawlbase, formerly ProxyCrawl, helps you stay anonymous while crawling the web, web crawling protection the way it should be.
Cost / License
- Freemium
- Proprietary
Application type
Platforms
- Online
Crawlbase, formerly ProxyCrawl, helps you stay anonymous while crawling the web, web crawling protection the way it should be.
Common Crawl builds and maintains an open repository of web crawl data that can be accessed and analyzed by anyone

A web scraping service to collect data from websites, without any programming or DIY tools.
SeekStorm - Search as a Service: high-performance search API provides full-text, real-time, instant search & crawling.


X-Byte Enterprise Crawling provides enterprise level web crawling service by leveraging cloud technology and Data as a Service (DaaS) model, helping data hungry enterprises of all sizes to make critical business decisions.

An enterprise grade, large scale web crawler and extraction engine built using Datoin Platform for all your Data Needs. Datoin platform is built on top of Apache Hadoop and customised Nutch crawler.