@harshvz/crawler Alternatives

@harshvz/crawler is described as 'A flexible web crawler and scraping tool using Playwright, supporting both BFS and DFS crawling strategies with screenshot capture and structured output. Installable via npm and usable both as a CLI and programmatically' and is an app. There are more than 25 alternatives to @harshvz/crawler for a variety of platforms, including Web-based, Windows, Linux, Mac and SaaS apps. The best @harshvz/crawler alternative is UI.Vision RPA, which is both free and Open Source. Other great apps like @harshvz/crawler are Scrapy, Otto, Reworkd and Portia.

Copy a direct link to this comment to your clipboard
@harshvz/crawler alternatives page was last updated

Alternatives list

  1. UI.Vision RPA icon
     120 likes

    Open-source task and test automation tool and Selenium IDE. The UI.Vision RPA software is a browser extension that can do desktop automation as well! Use it for web automation, form filling, screen scraping and Robotic Process Automation (RPA).

    144 UI.Vision RPA alternatives

    Cost / License

    • Freemium
    • Open Source

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    • Google Chrome
    • Mozilla Firefox
     
  2. Scrapy icon
     104 likes

    Scrapy is a free and open-source web-crawling framework written in Python. Originally designed for web scraping, it can also be used to extract data using APIs or as a general-purpose web crawler. It was developed and is maintained by Zyte formerly Scrapinghub, a web-scraping...

    105 Scrapy alternatives

    Cost / License

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    • BSD
     
  3. Otto icon
     7 likes

    Leverage AI agents through Otto's native table interface for automating manual research, enriching lists, conducting company research, and analyzing documents efficiently with customizable column prompts and autofill capabilities.

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Online
     
  4. Reworkd icon
     8 likes

    Reworkd allows for effortless web data extraction at scale without the need for coding or maintenance. It automates the entire web data pipeline, scanning websites, generating code, running extractors, validating results, and outputting data.

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Online
     
  5. Portia icon
     62 likes

    Portia is an open source visual scraping tool, allows you to scrape websites without any programming knowledge required! Simply annotate pages you're interested in, and Portia will create a spider to extract data from similar pages.

    Cost / License

    Application type

    Alerts

    • Discontinued

    Platforms

    • Linux
    • Vagrant
    • Docker
     
  6. import.io icon
     46 likes

    import.io is a web-based platform that puts the power of the machine readable web in your hands. Using our tools you can create an API or crawl an entire website in a fraction of the time of traditional methods, no coding required.

    110 import.io alternatives

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
     
  7. Lookyloo icon
     4 likes

    Lookyloo is a web interface that allows users to capture a website page and then display a tree of domains that call each other.

    Cost / License

    • Free
    • Open Source

    Application type

    Platforms

    • Windows
    • Linux
    • Online
     
  8. Apify icon
     18 likes

    Cloud platform enabling automated data extraction, web crawling, and browser workflow automation using reusable acts, headless browser support, advanced scheduling, persistent storage, API integrations, modular design and scalable resource management.

    108 Apify alternatives

    Cost / License

    • Freemium
    • Open Source

    Application type

    Platforms

    • Online
     
  9. ParseHub icon
     67 likes

    ParseHub is a web scraping tool built to handle the modern web.

    You can extract data from anywhere. ParseHub works with single-page apps, multi-page apps and just about any other modern web technology.

    ParseHub can handle Javascript, AJAX, cookies, sessions and redirects. You c.

    97 ParseHub alternatives

    Cost / License

    • Freemium
    • Proprietary

    Application type

    Platforms

    • Mac
    • Windows
    • Linux
    • Online
     
  10. artoo.js icon
     4 likes

    artoo.js is a piece of JavaScript code meant to be run in your browser's console to provide you with some scraping utilities.

    Cost / License

    • Free
    • Open Source (MIT)

    Application type

    Platforms

    • Online
    • Self-Hosted
    • Google Chrome
    • JavaScript
    • Node.JS
     
  11. ScrapingBee icon
     2 likes

    ScrapingBee is an API that handles web scraping challenges such as JavaScript rendering, operating Chrome headless, bypassing Captcha, and using proxies. It was formerly known as ScrapingNinja. The API manages numerous headless instances using the latest Chrome version, allowing...

    Cost / License

    • Paid
    • Proprietary

    Application type

    Platforms

    • Software as a Service (SaaS)
     
  12. PhantomBuster icon
     3 likes

    PhantomBuster offers no-code, multi-platform bots compatible with major sites like LinkedIn and Twitter for web scraping and lead generation. Cloud APIs ensure seamless integration, boosting productivity and supporting custom API creation for bespoke automation solutions.

    102 PhantomBuster alternatives

    Cost / License

    • Paid
    • Open Source

    Application type

    Platforms

    • Online
    • Mozilla Firefox
     
12 of 30 @harshvz/crawler alternatives