chat-with-gpt
agency
chat-with-gpt | agency | |
---|---|---|
39 | 5 | |
2,267 | 43 | |
- | - | |
5.3 | 7.0 | |
24 days ago | about 2 months ago | |
TypeScript | Go | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
chat-with-gpt
- Different chatGPT 4 API Interface?
-
Using API as a more powerful ChatGPT?
you can use https://www.chatwithgpt.ai/ , I like this + it's open source.
- I use chatGPT for hours everyday and can say 100% it's been nerfed over the last month or so. As an example it can't solve the same types of css problems that it could before. Imagine if you were talking to someone everyday and their iq suddenly dropped 20%, you'd notice. People are noticing.
- Hot Take: ChatGPT is not getting dumber, you are.
-
Show HN: LLaMA tokenizer that runs in browser
https://github.com/cogentapps/chat-with-gpt/blob/main/app/sr...
-
Is there a way to use one conversation as context for another?
Do you have api access? I use this repo called chat with chatgpt https://github.com/cogentapps/chat-with-gpt It literally is chatgpt website same look feel and conversation history, but you can adjust the creativeness (called temperature) the system prompt and what version you want to use.
-
OpenAI Employee: GPT-4 hasn't gotten worse since March
We've been using https://github.com/cogentapps/chat-with-gpt for a while, and overall happy with it, but its development is mostly dead.
-
I have been talking to the GPT-4 32k context length version for a couple of hours straight, and I can see how the average person might mistake it for some kind of intelligent living being after a few hours.
There are apps available that will take care of all this for you: https://github.com/cogentapps/chat-with-gpt is a popular one, if you need help to get it up and running just ask GPT-4 with 'browse with bing' to take a look and lead you by the hand
- Has ChatGPT Been Neutered?
-
What's the best ChatGPT web or Mac desktop client that let's you organize or search your past conversations?
So far I've tried https://github.com/ztjhz/BetterChatGPT and https://github.com/cogentapps/chat-with-gpt but I'm wondering if there is anything out there more robust? A Mac desktop client would be preferred if anyone knows? I tried MacGPT but the main functionality I am looking for is an ability to sort, search and potentially tag my conversations. Any leads would be appreciated! Much thanks!
agency
-
Show HN: LLaMA tokenizer that runs in browser
Tokenizers seem to be a massive pain in the neck if you are just calling into an API to use your model. The algorithm itself is non-trivial, and they need pretty sizable data to function: the vocabulary and the merges, which just sit there, using memory. I'm writing https://github.com/ryszard/agency in Go, and while there's a good library for the OpenAI tokenization, if you want a tokenizer for the HF models the best I found was a library calling HF's Rust implementation, which makes it horrible for distribution.
However, at some point I realized that I needed not really the tokens, but the token count, as my most important use was implementing a Token Buffer Memory (trim messages from the beginning in such a way that you never exceed a context size number of tokens). And in order to do that I don't need it to be exactly right, just mostly right, if I am ok with slightly suboptimal efficiency (keeping slightly less tokens than the model supports). So, I took files from Project Gutenberg, and compared the ratio of tokens I get using a proper tokenizer and just calling `strings.Split`, and it seems to be remarkably stable for a given model and language (multiply the length of the result of splitting on spaces by 1.55 for OpenAI and 1.7 for Claude, which leaves a tiny safety margin).
I'm not throwing shade at this project – just being able to call the tokenizer would've saved me a lot of time. But I hope that if I'm wrong about the estimates bring good enough some good person will point out the error of my ways :)
-
Understanding GPT Tokenizers
How I wish this post had appeared a few days earlier... I am writing on my own library for some agent experiments (in go, to make my life more interesting I guess), and knowing the number of tokens is important to implement a token buffer memory (as you approach the model's context window size, you prune enough messages from the beginning of the conversation that the whole thing keeps some given size, in tokens). While there's a nice native library in go for OpenAI models (https://github.com/tiktoken-go/tokenizer), the only library I found for Hugging Face models (and Claude, they published their tokenizer spec in the same JSON format) calls into HF's Rust implementation, which makes it challenging as a dependency in Go. What is more, any tokenizer needs to keep some representation of its vocabulary in memory. So, in the end I removed the true tokenizers, and ended up using an approximate version (just split it in on spaces and multiply by a factor I determined experimentally for the models I use using the real tokenizer, with a little extra for safety). If it turns out someone needs the real thing they can always provide their own token counter). I was actually rather happy with this result: I have less dependencies, and use less memory. But to get there I needed to do a deep dive too understand BPE tokenizers :)
(The library, if anyone is interested: https://github.com/ryszard/agency.)
-
[P] I got fed up with LangChain, so I made a simple open-source alternative for building Python AI apps as easy and intuitive as possible.
I completely agree about langchain being brittle; what I really hate is that it's really hard to make sense about what is going on by reading the code. I was similarly frustrated and rolled my own thing on go (shameless plug): https://github.com/ryszard/agency
- 🏢🤖Agency - An Idiomatic Go Interface for the OpenAI API🚀
- Agency - An Idiomatic Go Interface for the OpenAI API (request for feedback)
What are some alternatives?
ChatGPT-Next-Web - A cross-platform ChatGPT/Gemini UI (Web / PWA / Linux / Win / MacOS). 一键拥有你自己的跨平台 ChatGPT/Gemini 应用。
tokenizer - Pure Go implementation of OpenAI's tiktoken tokenizer
LibreChat - Enhanced ChatGPT Clone: Features OpenAI, Assistants API, Azure, Groq, GPT-4 Vision, Mistral, Bing, Anthropic, OpenRouter, Vertex AI, Gemini, AI model switching, message search, langchain, DALL-E-3, ChatGPT Plugins, OpenAI Functions, Secure Multi-User System, Presets, completely open-source for self-hosting. More features in development
Constrained-Text-Genera
chatwithme.chat - Open source ChatGPT UI
Constrained-Text-Generation-Studio - Code repo for "Most Language Models can be Poets too: An AI Writing Assistant and Constrained Text Generation Studio" at the (CAI2) workshop, jointly held at (COLING 2022)
plurality - A cornucopia of open source UIs built with ChatGPT API.
llama-tokenizer-js - JS tokenizer for LLaMA and LLaMA 2
human-eval - Code for the paper "Evaluating Large Language Models Trained on Code"
panml - PanML is a high level generative AI/ML development and analysis library designed for ease of use and fast experimentation.
ruby-openai - OpenAI API + Ruby! 🤖❤️ Now with Assistants v2, Batches & Ollama/Groq 🚀
feste - Feste is a free and open-source framework allowing scalable composition of NLP tasks using a graph execution model that is optimized and executed by specialized schedulers.