Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Apify SDK monorepo

Apify command-line interface helps you create, develop, build and run Apify actors, and manage the Apify cloud platform.

Professional scrapers that provide full control to the users. Crawlee One builds on top of Crawlee and Apify and extends them with features for robust and highly configurable web scrapers.

Generic REST API for scraping websites. Drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!

Web application for recording, management and editing of inteligent RPA workflows using Playwright technology

Scrape any Twitter user profile. Extract tweets, retweets, replies, favorites, and conversation threads with no Twitter API limits

Apify actor extracting data from Zalando

Grab a session for any website for usage on your own actor

Analyzes target website for anti-scraping protections and performance. Saves screenshots/HTML snapshots.

Scraper for www.webdesignernews.com, using Apify.

YouTube AutoComplete Scraper - An Apify actor that scrapes YouTube's search suggestions with intelligent deduplication using pglite and trigram similarity matching. Perfect for content research, SEO, and trend analysis.

Search organisations from Erasmus+ and European Solidarity Corps programmes. Define search criteria such as legal name, business name, hyperlink, PIC or an OID from: https://webgate.ec.europa.eu/erasmus-esc/index/organisations/search-for-an-organisation

A Simple Craigslist Scraper Created using Crawlee to Test the Apify Platform

Essential TypeScript libraries and utilities for building production-ready AI SaaS applications

Apify actor extracting data from Zoot.cz, Zoot.sk and Zoot.ro

serverless app to take screenshot of facebook page using facebook api.

Easily access, manage, and manipulate a global state/multiple global states for an Apify actor's run

A serverless app to run all the actors/programs in parallel. Generic version.

Examples of Crawlee scraper and Apify actor for NSWI126 course at MFF UK