turbopilot VS gpt4all

fyi https://github.com/ravenscroftj/turbopilot

TurboPilot: self-hosted copilot clone which uses the library behind llama.cpp to run the 6 Billion Parameter Salesforce Codegen model in 4GiB of RAM. (https://github.com/ravenscroftj/turbopilot)

This repo has a potential

Right now https://github.com/ggerganov/llama.cpp is the dominant back-end for querying models, but forks and alternatives like https://github.com/ravenscroftj/turbopilot keep popping up. Increasingly, models submitted to huggingface explicitly note in their READMEs that the model is not compatible with llama.cpp, and that a different back-end must be used.

There's turbopilot. I haven't tried it yet, but it looks promising.

Turbopilot | open source LLM code completion engine and Copilot alternative

This 6B parameters tool (based on README) could be runned with 4 Gb of RAM. https://github.com/ravenscroftj/turbopilot

there is an interesting link https://github.com/ravenscroftj/turbopilot/wiki/Converting-and-Quantizing-The-Models , just wondering if anyone have done this with 16b and put the weights somewhere

I don’t know if Ollama can do this but https://gpt4all.io/ can.

Gpt4all is a local desktop app with a Python API that can be trained on your documents: https://gpt4all.io/

The readme page is cryptic. What does 'mature' mean in this context? What is the sample text a continuation of?

Hving a gif the thing in use would be great, similar to the gpt4all readme page. (https://github.com/nomic-ai/gpt4all)

Check https://github.com/nomic-ai/gpt4all instead.

"I ran performance tests on two systems, here's the results of system 1, and heres the results of system 2. Summarize the results, and build a markdown table containing x,y,z rows."

"extract the reusable functions out of this bash script"

"write me a cfssl command to generate a intermediate CA"

"What is the regex for _____"

"Here are my accomplishments over the last 6 months, summarize them into a 1 page performance report."

etc etc etc

If you're not using GPT4 or some LLM as part of your daily flow you're working too hard.

Get GPT4All (https://gpt4all.io), log into OpenAI, drop $20 on your account, get a API key, and start using GPT4.

offline versija, nors ir ne tokia pažengus - https://github.com/nomic-ai/gpt4all ; https://gpt4all.io/index.html

Take a look at https://gpt4all.io, their docs are pretty awesome

I run one. I built an iMessage-like frontend to it using plain JS and a Python websocket backend. I mostly just use it for curiosity and playing with different prompts. I only have 16GB of RAM to dedicate to it, so I use an 8B parameter model which is enough for fun and chitchat, but I don't find it good enough to replace ChatGPT.

https://github.com/nomic-ai/gpt4all