Apps with 'Web Crawler' feature Page 3 of 4

Dexi is the most comprehensive web data processing tool for professionals. Extract, enrich & connect any data source to any other data source. Also known to be most advanced web scraping tool. All available in your browser - try it for free.

The primary focus of this web crawler is to make it easier for enterprise search integrators and developers when dealing with all types of crawling requirements. We wanted for ourselves something very portable, extensible, modular, and working with most search engines.

Site Analyzer is the most efficient website analyzer platform so you can improve your online visibility and rank at the top of search engines.

A web scraping service to collect data from websites, without any programming or DIY tools.

The Audisto Crawler is a website crawling tool with a strong focus on SEO. It automatically detects and analyses all URLs from a website and points out optimization potential.

Comprehensive network management on Android with real-time monitoring, advanced tools, graphs, device organization, VPN remote access, and premium scanner features.

Datahut is a web scraping service that helps companies gather data from web pages. It allows you to access web data at an affordable cost and eliminates vendor lock-in by using open source technologies. The Best part - 100% money back guarantee.

ScrapeWise is a no-code web scraping infrastructure platform that lets business teams extract structured data from any publicly accessible website without writing code or depending on developers.

WallPaper (alias crawlpaper) is a desktop changer (NOT a screensaver) which includes a web crawler for picture download, an audio stream ripper, an audio player, a mini mp3 tag editor,etc. Also included support for .zip and .rar files.

Botsol Google Maps Crawler automates extracting business information from Google Maps for lead generation, local SEO, and market research. Search Google Maps the way you normally would, start the crawler, and it extracts business names, addresses, phone numbers, websites...

Turn any website into data with ScrapeUp API, which handles browsers, proxy rotation, and CAPTCHAs so developers can easily scrape any webpages with a single API call.

Broken Link Scan is a web-based link checker and site crawler. Enter any URL and it will crawl up to 500 pages for free, verifying every link, image, media resource, redirect chain and SSL certificate. Results are quick, with a health-score dashboard and an internal-vs-external...

Local-first MCP server and CLI in Rust: any page as LLM-ready Markdown, whole-site crawls, keyless search, and local captcha solving. No cloud, no API keys.

SeekStorm - Search as a Service: high-performance search API provides full-text, real-time, instant search & crawling.

The world's most powerful search. Business-grade search and crawling for any web data.

Turn any website into clean, LLM-ready data. Open-source web crawler with stealth mode, distributed crawling, real-time WebSocket progress & Markdown output. Power your AI apps with GcrawlAI.

ACHE is a web crawler for domain-specific search.

MediaPocket is an applications that can help you to download photos, videos and even entire pages from your favorite blogs in an instant. All you have to do is type a suitable blog address in the designated field and click the "Play" button available in the main...

Looksy is an advanced web scraper that uses smart search tools, recursive URL discovery, multithreading, human behaviour emulation, and intelligent filename guessing to efficiently find and download images and other files.

MainREST - web scrapping platform (framework) with API access.

Automated website health monitoring — broken links, SEO, accessibility, performance and security checks on a schedule, with email, webhook, CSV and PDF reports.

FandangoSEO is an SEO Cloud tool that consists of a Crawler, a Log Monitoring, and a Competitive Analysis Tool. It provides valuable reports to master SEO strategies, improve the crawl budget, and increase the mobile and desktop traffic.

Cloudtrellis scans your entire site for broken links, accessibility issues, and SEO improvements to ensure a flawless user experience.

Collect news articles easily from any sources in any language. API, MySQL, ElasticSearch integration.

Analyzes any public site for agent and LLM accessibility, scores agent-readability 0–100, explains each issue in plain English, and gives fixes for compliance.