shell_gpt VS GPTCache

https://github.com/TheR1D/shell_gpt?tab=readme-ov-file#shell...

I would like to stay in the terminal, and am using https://github.com/TheR1D/shell_gpt, my format is simply to send GPT a file to discuss:

ShellGPT https://github.com/TheR1D/shell_gpt does pretty well for a lot of use cases. I mostly use it in REPL mode, switching topics as needed. I have wrappers around the `sgpt` command to, say, start a REPL with a particular topic, say, Python, which loads my previous history on that topic as part of the prompt.

I also have an alias to save existing chats as text files so I can go back and review history.

Finally, there is an alias to load a question up in an editor if I need to enter multiline text, e.g. to discuss code fragments, etc.

I expect command-line workflows to be pretty individualized and I'm curious what others do. For me (old programmer), using a command line REPL feels much more natural (and blissfully noise-free) than going to a Web page to talk to, say, ChatGPT.

The API still works. I've been using https://github.com/TheR1D/shell_gpt/ in my workflow.

I recommend shell-gpt[1] for anyone with access to the OpenAI API. It works surprisingly well considering how simple it is. Be sure to browse the examples in the README.

[1] https://github.com/TheR1D/shell_gpt

Nice idea. You may want to mention in the docs that it requires https://github.com/TheR1D/shell_gpt ;)

I honestly bought the device just to play with the wearable version of my android app: a voice controlled ssh client that let me also pass voice input to shell_gpt. Other pre installed apps won't really work on this device, including google assistant, so I had to switch to google cloud speech to text APIs for speech recognition. I can still sideload compatible apps via bluetooth debugging tho

Maybe this can help : https://github.com/TheR1D/shell_gpt

I'm not really following these but they tend to get released every other day, like https://github.com/nlml/YoCLI/ and https://github.com/TheR1D/shell_gpt

Just found this: https://github.com/zilliztech/GPTCache which seems to address this idea/issue.

21. GPTCache | Github | tutorial

Check this out. Built on a vector database (https://github.com/milvus-io/milvus) and a semantic cache (https://github.com/zilliztech/GPTCache)

https://osschat.io/

With the proliferation of large models, an increasing number of enterprises and individual developers are now developing applications based on these models. As such, it is worth considering whether large model caching is necessary during the development process.

Our project: https://github.com/zilliztech/GPTCache

Maybe [GPTCache](https://github.com/zilliztech/GPTCache) can make it more attractive, because similar problems can be less expensive, and can also be responded to faster. Of course, the specific configuration needs to be based on real usage scenarios.