picoGPT VS gpt4all

In that case, you might also enjoy https://jaykmody.com/blog/gpt-from-scratch/

(here's the raw code: https://github.com/jaymody/picoGPT/blob/main/gpt2.py)

I wrote a minimal implementation in NumPy here (the forward pass code is only 40 lines): https://github.com/jaymody/picoGPT

Although this is for a decoder-only transformer (aka GPT) and doesnt include the encoder part.

Take a look at https://github.com/jaymody/picoGPT/blob/a750c145ba4d09d57648...

Yes, this is GPT-2 not 4 and it‘s not the Chat, only the model and it‘s basically only the inference part, not the training loop and it‘s somewhat simplified.

Still, take a good look.

That‘s essentially what it is and a single sheet of paper.

There is nothing specifically about language in „language model“, we just call it that. Better to call it just LLM.

Nobody knows exactly what it learns, although there would be ways to poke around given some research programs. But it seems like the interest in that is limited currently, everyone is busy with improving it or with applications.

Perhaps the answer is that we overestimated what a mind is. It‘s like we used to ask what life is and it turned out that there is nothing special about life, not even the DNA is controlling anything. It‘s merely a chemical process, even though a complex process.

(The hardest part was just designing a math function that has the capability of getting good at this game, but when all is said and done, it need not be a whole lot of code).

I don’t know if Ollama can do this but https://gpt4all.io/ can.

Gpt4all is a local desktop app with a Python API that can be trained on your documents: https://gpt4all.io/

The readme page is cryptic. What does 'mature' mean in this context? What is the sample text a continuation of?

Hving a gif the thing in use would be great, similar to the gpt4all readme page. (https://github.com/nomic-ai/gpt4all)

Check https://github.com/nomic-ai/gpt4all instead.

"I ran performance tests on two systems, here's the results of system 1, and heres the results of system 2. Summarize the results, and build a markdown table containing x,y,z rows."

"extract the reusable functions out of this bash script"

"write me a cfssl command to generate a intermediate CA"

"What is the regex for _____"

"Here are my accomplishments over the last 6 months, summarize them into a 1 page performance report."

etc etc etc

If you're not using GPT4 or some LLM as part of your daily flow you're working too hard.

Get GPT4All (https://gpt4all.io), log into OpenAI, drop $20 on your account, get a API key, and start using GPT4.

offline versija, nors ir ne tokia pažengus - https://github.com/nomic-ai/gpt4all ; https://gpt4all.io/index.html

Take a look at https://gpt4all.io, their docs are pretty awesome

I run one. I built an iMessage-like frontend to it using plain JS and a Python websocket backend. I mostly just use it for curiosity and playing with different prompts. I only have 16GB of RAM to dedicate to it, so I use an 8B parameter model which is enough for fun and chitchat, but I don't find it good enough to replace ChatGPT.

https://github.com/nomic-ai/gpt4all