chat.petals.dev

đź’¬ Chatbot web app + HTTP and Websocket endpoints for LLM inference with the Petals client (by petals-infra)

Chat.petals.dev Alternatives

Similar projects and alternatives to chat.petals.dev

  1. askai

    Command Line Interface for OpenAi ChatGPT (by yudax42)

  2. Nutrient

    Nutrient - The #1 PDF SDK Library. Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free.

    Nutrient logo
  3. ipfs

    Peer-to-peer hypermedia protocol

  4. ollama

    Get up and running with Llama 3.3, DeepSeek-R1, Phi-4, Gemma 2, and other large language models.

  5. KoboldAI-Client

    For GGUF support, see KoboldCPP: https://github.com/LostRuins/koboldcpp

  6. SecretNetwork

    đť•Š The Secret Network

  7. petals

    🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading

  8. artbot-for-stable-diffusion

    A front-end GUI for interacting with the AI Horde / Stable Diffusion distributed cluster

  9. CodeRabbit

    CodeRabbit: AI Code Reviews for Developers. Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.

    CodeRabbit logo
  10. axolotl

    Go ahead and axolotl questions

  11. LoRA

    Code for loralib, an implementation of "LoRA: Low-Rank Adaptation of Large Language Models"

  12. ggml

    Tensor library for machine learning (by philpax)

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better chat.petals.dev alternative or higher similarity.

chat.petals.dev discussion

Log in or Post with

chat.petals.dev reviews and mentions

Posts with mentions or reviews of chat.petals.dev. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-12-07.
  • Make no mistake—AI is owned by Big Tech
    2 projects | /r/transhumanism | 7 Dec 2023
    ETA: https://chat.petals.dev
  • Run LLMs in bittorrent style
    2 projects | /r/opensource | 20 Nov 2023
    Check it out at Petals.dev. Chatbot
  • Run LLMs at home, BitTorrent‑style
    10 projects | news.ycombinator.com | 17 Sep 2023
    Hi, a dev here. means "end of sequence" for LLMs. If a model generates it, it forgets everything and continue with an unrelated random text. So I don't think that malicious actors are involved here.

    Apparently, the Colab code snippet is just too simplified and does not handle correctly. This is not the case with the full chatbot app at https://chat.petals.dev - you can use it instead or take a look at its code.

  • Falcon180B: authors open source a new 180B version!
    1 project | /r/LocalLLaMA | 8 Sep 2023
    edit: this community of people is amazing. like 10 minutes after I posted this or so.... it is now up on chat.petals.dev !!!!
  • Talk to Falcon 180B-Chat running over Petals
    1 project | news.ycombinator.com | 6 Sep 2023
  • ChatGPT Is Down Again
    2 projects | news.ycombinator.com | 31 Aug 2023
    good opportunity to try the free and totally open source Big Science Petals chat: https://chat.petals.dev/ ... Try out Stable Beluga 2 70B

    I am currently running my 3090 GPU on there to help out, you can check out https://health.petals.dev/

    If you have a spare GPU, consider contributing: https://github.com/bigscience-workshop/petals . I am not associated with them.

  • Sweating Bullets Test
    1 project | /r/LocalLLaMA | 6 Aug 2023
    So far, not a single one of the models tested (between 7b-70b) could figure out the name of the main character (Nick Slaughter). I've tried all sorts of prompts and the connection between "Tropical Heat" and "Sweating Bullets" is usually known to the model (e.g. "What's the show "Tropical Heat" called in the US?"). But as soon as I ask about the main character, all the models I have tested so far hallucinate all sorts of names, though usually in the right direction (detectives).
  • Petals: Run 100B+ models at home bit-torrent style
    6 projects | news.ycombinator.com | 2 Jan 2023
  • A note from our sponsor - Nutrient
    nutrient.io | 19 Feb 2025
    Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free. Learn more →

Stats

Basic chat.petals.dev repo stats
8
308
7.1
10 months ago

Sponsored
Nutrient - The #1 PDF SDK Library
Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free.
nutrient.io

Did you know that Python is
the 2nd most popular programming language
based on number of references?