Python large-scale

Open-source Python projects categorized as large-scale

Top 4 Python large-scale Projects

large-scale
  1. ColossalAI

    Making large AI models cheaper, faster and more accessible

    Project mention: FLaNK AI-April 22, 2024 | dev.to | 2024-04-22
  2. Nutrient

    Nutrient – The #1 PDF SDK Library, trusted by 10K+ developers. Other PDF SDKs promise a lot - then break. Laggy scrolling, poor mobile UX, tons of bugs, and lack of support cost you endless frustrations. Nutrient’s SDK handles billion-page workloads - so you don’t have to debug PDFs. Used by ~1 billion end users in more than 150 different countries.

    Nutrient logo
  3. oasis

    🏝️ OASIS: Open Agent Social Interaction Simulations with One Million Agents. https://oasis.camel-ai.org (by camel-ai)

    Project mention: Show HN: Oasis – Open Agent Social Interaction Simulations | news.ycombinator.com | 2025-01-28
  4. dsir

    DSIR large-scale data selection framework for language model training

  5. FaceDB

    A package designed for efficient face recognition across extensive photo collections, optimized for large-scale processing.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

Python large-scale discussion

Log in or Post with

Python large-scale related posts

  • Show HN: Oasis – Open Agent Social Interaction Simulations

    1 project | news.ycombinator.com | 28 Jan 2025
  • Show HN: Open Agent Social Interaction Simulations (Oasis) with 1M Agents

    1 project | news.ycombinator.com | 14 Jan 2025
  • Oasis: Open Agents Social Interaction Simulations on One Million Agents

    1 project | news.ycombinator.com | 14 Jan 2025
  • Making large AI models cheaper, faster and more accessible

    1 project | news.ycombinator.com | 21 Mar 2024
  • ColossalChat: An Open-Source Solution for Cloning ChatGPT with a RLHF Pipeline

    1 project | news.ycombinator.com | 4 Apr 2023
  • Meet ColossalChat: An Open-Source AI Solution For Cloning ChatGPT With A Complete RLHF Pipeline

    1 project | /r/machinelearningnews | 1 Apr 2023
  • A top AI researcher reportedly left Google for OpenAI after sharing concerns the company was training Bard on ChatGPT data

    1 project | /r/technology | 30 Mar 2023
  • A note from our sponsor - Nutrient
    www.nutrient.io | 15 Feb 2025
    Other PDF SDKs promise a lot - then break. Laggy scrolling, poor mobile UX, tons of bugs, and lack of support cost you endless frustrations. Nutrient’s SDK handles billion-page workloads - so you don’t have to debug PDFs. Used by ~1 billion end users in more than 150 different countries. Learn more →

Index

What are some of the best open-source large-scale projects in Python? This list will help you:

# Project Stars
1 ColossalAI 39,061
2 oasis 647
3 dsir 242
4 FaceDB 59

Sponsored
Nutrient – The #1 PDF SDK Library, trusted by 10K+ developers
Other PDF SDKs promise a lot - then break. Laggy scrolling, poor mobile UX, tons of bugs, and lack of support cost you endless frustrations. Nutrient’s SDK handles billion-page workloads - so you don’t have to debug PDFs. Used by ~1 billion end users in more than 150 different countries.
www.nutrient.io

Did you know that Python is
the 2nd most popular programming language
based on number of references?