Continue with LocalAI: An alternative to GitHub's Copilot that runs everything locally

This page summarizes the projects mentioned and recommended in the original post on /r/selfhosted

Nutrient - The #1 PDF SDK Library
Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free.
nutrient.io
featured
CodeRabbit: AI Code Reviews for Developers
Revolutionize your code reviews with AI. CodeRabbit offers PR summaries, code walkthroughs, 1-click suggestions, and AST-based analysis. Boost productivity and code quality across all major languages with each PR.
coderabbit.ai
featured
  1. WizardLM

    Discontinued Family of instruction-following LLMs powered by Evol-Instruct: WizardLM, WizardCoder and WizardMath

    If you pair this with the latest WizardCoder models, which have a fairly better performance than the standard Salesforce Codegen2 and Codegen2.5, you have a pretty solid alternative to GitHub Copilot that runs completely locally.

  2. Nutrient

    Nutrient - The #1 PDF SDK Library. Bad PDFs = bad UX. Slow load times, broken annotations, clunky UX frustrates users. Nutrient’s PDF SDKs gives seamless document experiences, fast rendering, annotations, real-time collaboration, 100+ features. Used by 10K+ devs, serving ~half a billion users worldwide. Explore the SDK for free.

    Nutrient logo
  3. LocalAI

    :robot: The free, Open Source alternative to OpenAI, Claude and others. Self-hosted and local-first. Drop-in replacement for OpenAI, running on consumer-grade hardware. No GPU required. Runs gguf, transformers, diffusers and many more models architectures. Features: Generate Text, Audio, Video, Images, Voice Cloning, Distributed, P2P inference

    Here's my tutorial on how to run this setup on docker-compose to test it in a simple way

  4. homelab

    A self-managed ArgoCD homelab kubernetes cluster using Talos (by gruberdev)

    Do you want to test this setup on Kubernetes? Here is my resources that deploy LocalAI on my cluster with GPU support. Not sure on how to use GPU with Kubernetes on homelab setups? I wrote an article explaining how I configured my k3s to run using Nvidia's drivers and how they integrate with containerd.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • ArgoCD // Helm Chart // Dev/Staging // Your Best-Practise

    3 projects | /r/kubernetes | 6 Jul 2023
  • win cool stuff with kubefirst's new video game flappy-kray (oh and we have a new ui too i guess)

    1 project | /r/kubernetes | 23 Jun 2023
  • PSA: short-sha container names? guard your strings or face the eventual wrath of euler's number!!

    1 project | /r/kubernetes | 28 Apr 2023
  • Am I missing something? (argo cd and helm in AWS)

    2 projects | /r/devops | 29 Jan 2023
  • How to obtain professional Kubernetes experience?

    2 projects | /r/kubernetes | 27 Jan 2023