apify

Open-source projects categorized as apify
Edit details
Language: + TypeScript + Python + Rust + JavaScript
Topics: Scraping SDK JavaScript Crawler Python
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured

Top 6 apify Open-Source Projects

apify

  • crawlee

    Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

    • Project mention: Crawlee: Crawlee–build reliable crawlers. Works with Puppeteer, Playwright, Ch | news.ycombinator.com | 2024-05-24

  • apify-sdk-python

    The Apify SDK for Python is the official library for creating Apify Actors in Python. It provides useful features like actor lifecycle management, local storage emulation, and actor event handling.

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo

  • apify-sdk-js

    Apify SDK monorepo

    • Project mention: Scrapy Vs. Crawlee | dev.to | 2024-05-15

    Crawlee is also an open-source library that originated as Apify SDK. Crawlee has the advantage of being the latest library in the market, so it already has many features that Scrapy lacks, like autoscaling, headless browsing, working with JavaScript rendered websites without any plugins, and many more, which we are going to explain later on.

  • apify-client-python

    Apify API client for Python

  • actor-rust-scraper

    Experimental scraper in Rust suited for running locally or on the Apify platform. Inspired by Apify SDK.

    • Project mention: I'm trying and failing to compile someone else's project to wasm. | /r/learnrust | 2023-07-17

    I'm trying to compile this scraper to wasm, the goal being running it on docker wasi/wasm.

  • airbnb-scraper

    Apify public actor for scraping Airbnb homes.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

apify related posts

  • Automating Data Collection with Apify: From Script to Deployment

    4 projects | dev.to | 17 Mar 2024

  • I'm trying and failing to compile someone else's project to wasm.

    2 projects | /r/learnrust | 17 Jul 2023

  • Build and run your Python web scrapers in the cloud with Apify SDK for Python

    1 project | /r/programming | 20 Mar 2023

  • This Week In Python

    5 projects | dev.to | 18 Mar 2023

  • Build and run your Python web scrapers in the cloud with Apify SDK for Python

    2 projects | /r/Python | 14 Mar 2023

  • Build and run your Python web scrapers in the cloud with Apify SDK for Python

    2 projects | /r/webscraping | 14 Mar 2023

  • Free Tool for getting price comparisons?

    1 project | /r/airbnb_hosts | 1 Sep 2021
  • A note from our sponsor - SurveyJS
    surveyjs.io | 4 Jun 2024
    With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js. Learn more →

Index

What are some of the best open-source apify projects? This list will help you:

Project Stars
1 crawlee 12,621
2 apify-sdk-python 110
3 apify-sdk-js 108
4 apify-client-python 41
5 actor-rust-scraper 10
6 airbnb-scraper 9

Sponsored
Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App
With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.
surveyjs.io