petals

🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading (by bigscience-workshop)

Petals Alternatives

Similar projects and alternatives to petals

  1. text-generation-webui

    A Gradio web UI for Large Language Models with support for multiple inference backends.

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. llama.cpp

    LLM inference in C/C++

  4. ollama

    479 petals VS ollama

    Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 3, Mistral Small 3.1 and other large language models.

  5. whisper

    366 petals VS whisper

    Robust Speech Recognition via Large-Scale Weak Supervision

  6. Open-Assistant

    OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

  7. boinc

    214 petals VS boinc

    Open-source software for volunteer computing and grid computing.

  8. mycroft-core

    Discontinued Mycroft Core, the Mycroft Artificial Intelligence platform.

  9. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
  10. whisper.cpp

    Port of OpenAI's Whisper model in C/C++

  11. llama

    188 petals VS llama

    Inference code for Llama models

  12. KoboldAI-Client

    For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp

  13. stanford_alpaca

    Code and documentation to train Stanford's Alpaca models, and generate the data.

  14. alpaca-lora

    107 petals VS alpaca-lora

    Instruct-tune LLaMA on consumer hardware

  15. GPTQ-for-LLaMa

    4 bits quantization of LLaMA using GPTQ

  16. hivemind

    40 petals VS hivemind

    Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

  17. FlexLLMGen

    39 petals VS FlexLLMGen

    Discontinued Running large language models on a single GPU for throughput-oriented scenarios.

  18. PaLM-rlhf-pytorch

    Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

  19. GLM-130B

    19 petals VS GLM-130B

    GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

  20. chat.petals.dev

    💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

  21. SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better petals alternative or higher similarity.

petals discussion

Log in or Post with

petals reviews and mentions

Posts with mentions or reviews of petals. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-09-08.

Stats

Basic petals repo stats
101
9,606
7.2
8 months ago

bigscience-workshop/petals is an open source project licensed under MIT License which is an OSI approved license.

The primary programming language of petals is Python.


Sponsored
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com

Did you know that Python is
the 2nd most popular programming language
based on number of references?