Petals Alternatives

Similar projects and alternatives to petals

• text-generation-webui

  876 35,862 9.9 Python petals VS text-generation-webui

  A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

• llama.cpp

  769 55,846 10.0 C++ petals VS llama.cpp

  LLM inference in C/C++

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• whisper

  343 59,916 6.8 Python petals VS whisper

  Robust Speech Recognition via Large-Scale Weak Supervision

  

• Open-Assistant

  329 36,622 9.1 Python petals VS Open-Assistant

  OpenAssistant is a chat-based assistant that understands tasks, can interact with third-party systems, and retrieve information dynamically to do so.

  

• boinc

  213 1,915 9.6 PHP petals VS boinc

  Open-source software for volunteer computing and grid computing.

  

• mycroft-core

  212 6,452 0.0 Python petals VS mycroft-core

  Mycroft Core, the Mycroft Artificial Intelligence platform.

  

• ollama

  192 58,943 9.9 Go petals VS ollama

  Get up and running with Llama 3, Mistral, Gemma, and other large language models.

  

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• llama

  184 52,603 8.1 Python petals VS llama

  Inference code for Llama models

  

• whisper.cpp

  187 30,942 9.8 C petals VS whisper.cpp

  Port of OpenAI's Whisper model in C/C++

• KoboldAI-Client

  185 3,344 6.3 Python petals VS KoboldAI-Client

• alpaca-lora

  107 18,167 3.6 Jupyter Notebook petals VS alpaca-lora

  Instruct-tune LLaMA on consumer hardware

• stanford_alpaca

  108 28,761 2.0 Python petals VS stanford_alpaca

  Code and documentation to train Stanford's Alpaca models, and generate the data.

  

• GPTQ-for-LLaMa

  75 2,904 8.6 Python petals VS GPTQ-for-LLaMa

  4 bits quantization of LLaMA using GPTQ

• hivemind

  40 1,833 5.9 Python petals VS hivemind

  Decentralized deep learning in PyTorch. Built to train models on thousands of volunteers across the world.

  

• FlexGen

  39 8,999 3.0 Python petals VS FlexGen

  Running large language models on a single GPU for throughput-oriented scenarios.

  

• GLM-130B

  19 7,607 4.8 Python petals VS GLM-130B

  GLM-130B: An Open Bilingual Pre-Trained Model (ICLR 2023)

  

• PaLM-rlhf-pytorch

  25 7,590 4.6 Python petals VS PaLM-rlhf-pytorch

  Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

• laion.ai

  25 101 8.6 HTML petals VS laion.ai
  

• chat.petals.dev

  8 296 7.5 Python petals VS chat.petals.dev

  💬 Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client

  

• Auto-GPT

  104 72,359 9.8 Python petals VS Auto-GPT

  Discontinued An experimental open-source attempt to make GPT-4 fully autonomous. [Moved to: https://github.com/Significant-Gravitas/Auto-GPT] (by Torantulino)

  

• SaaSHub

  www.saashub.com sponsored

  SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives