self-hosted AI?

• serge

  40 5,535 9.8 Svelte

  A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

  

https://github.com/nsarrazin/serge I’m running this right now - it’s nice and chatgpt like but could be better, I’m still humming and hawing about purchasing some paid tier in openai. The code stuff is just way better than anything out there.

• alpaca.cpp

  94 9,878 9.4 C

  Discontinued Locally run an Instruction-Tuned Chat-Style LLM

It should have been in the Readme, I'm not sure why the project took it out but download resources are still available in the commit log https://github.com/antimatter15/alpaca.cpp/commit/285ca17ecbb6e7f1ef38c04bf9d961979e31b9d9

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• memos

  39 27,145 9.9 Go

  An open source, lightweight note-taking service. Easily capture and share your great thoughts.

  

• chatbot-ui

  63 26,051 9.4 TypeScript

  AI chat for every model.

Are you trying to self-host the AI itself, or just the interface? If the latter, here is a Docker container.

• dolly

  41 10,784 7.2 Python

  Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

  

• aitextgen

  19 1,826 1.8 Python

  A robust Python tool for text-based AI training and generation using GPT-2.

I'm experimenting with https://github.com/minimaxir/aitextgen for some some simple tasks. It is pretty much a wrapper around gpt2 and gpt neox models.

• dalai

  59 13,044 6.5 CSS

  The simplest way to run LLaMA on your local machine

You should checkout https://github.com/cocktailpeanut/dalai it so easy to setup with docker and get up and running (as long as you have enough ram)

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• gpt4all

  139 64,046 9.8 C++

  gpt4all: run open-source LLMs anywhere

  

That's interesting! I've just tested gpt4all on my Mac mini M1 with the 7B model and it's not very good (and becomes very slow in its responses after 3-4 questions). I wonder if my little Mac is not very suitable for this. I wonder too a couple of questions:

Suggest a related project