EdgeGPT VS alpaca.cpp

Wallpaper: Forest Stairs Chatbot: Edge GPT Scratchpad: HPR Scratcher(Is not maintained anymore, but still works. The main project is now Pyprland, but stopped working for me currently)

# Read and parse cookies cookies = None if args.cookie_file: cookies = json.loads(open(args.cookie_file, encoding="utf-8").read()) bot = await Chatbot.create(proxy=args.proxy, cookies=cookies) session = _create_session() completer = _create_completer(["!help", "!exit", "!reset"]) initial_prompt = args.prompt https://github.com/acheong08/EdgeGPT/blob/master/src/EdgeGPT.py

Yes, there is this extension: https://github.com/acheong08/EdgeGPT

EdgeGPT extension for Text Generation Webui based on EdgeGPT by acheong08. Now you can give Internet access to your chatbot, easily, quickly and free.

Have a look at this project. Also worth checking out his other repos, such as this one (not sure what exactly is different) or this one for the bing chat.

# Bing Conversation **Human:*\*  I want to simulate inner thinking for a chatbot so I want to link 2 instances of bingchat & make them prompt eachother I am gonna use this unnoficial api https://github.com/acheong08/EdgeGPT to do that, read the documentations for the repo provided and give me code to achieve the mentioned goals *** **Assistant:*\* I’m glad you’re interested in simulating inner thinking for a chatbot. I can help you with some code snippets to use EdgeGPT, a reverse engineered API of Microsoft’s Bing Chat AI[1](https://github.com/acheong08/EdgeGPT).

Hey folks! I'm not sure if it's done before but I just made a discord bot using bing chat on top of open-source EdgeGPT. Used bing chat because it's one of the easiest ways to interact with GPT-4 IMO together with active web browsing. The bot is able to handle /ask and /imagine commands. Happy to have your feedback or issues if you encounter any. Cheers!

Where's the 30B-in-6GB claim? ^FGB in your GH link finds [0] which is neither by jart nor by ggerganov but by another user who promptly gets told to look at [1] where Justine denies that claim.

  [0] https://github.com/antimatter15/alpaca.cpp/issues/182

You can just download the language model, dude!!! Everyone doesn’t need to make their own and the open source models literally get better every day.

Alpaca

Square could have also trained a more specific data source for their NLP, very similar to Alpaca. Alpaca was trained from interactions from a larger dataset. So while it isn't as smart, it's still able to understand instructions and act upon them.

The model I found was in 8 parts. The alpaca.cpp chat client (chat.cpp) needs to be modified to run the 8 part model, documented here: https://github.com/antimatter15/alpaca.cpp/issues/149

try the instructions on this github repo https://github.com/antimatter15/alpaca.cpp, its not the best one but I was able to run this model on my linux machine with 16GB memory, I think its a good starting point.

Doesn't run offline. If you're running something without a beefy-ish GPU, there's https://github.com/antimatter15/alpaca.cpp .

Ye, atm. toying with alpaca 7B/13B in a local install.