llm VS character-editor

We're open-sourcing a project that lets you build simple automations/agent workflows that use LLMs for different tasks. Kinda like Zapier or IFTTT but focused on using natural language to accomplish your tasks.It's super early but we'd love to start getting feedback to steer it in the right direction. It currently supports OpenAI and local models through llm.

> Tensorflow is a C++ framework that has Python bindings and a Python library, but when the models are served they are running on C++

Sure, and it's only a simple 20 step process that involves building Tensorflow from source. Yeay!

https://medium.com/@hamedmp/exporting-trained-tensorflow-mod...

Let me see what the process for compiling a LLM written in Rust is....

https://github.com/rustformers/llm

    cargo install llm-cli

Floneum is a graph editor for local AI workflows. It uses llm to run large language models locally, egui, and dioxus for the frontend, and wasmtime for the plugin system. If you are interested in the project, consider joining the discord, or building a plugin for Floneum in rust using WASI

Run inference for Large Language Models on CPU, with Rust (https://github.com/rustformers/llm)

On the rustformers github page I see that one of the commands to generate the answer is llm llama infer -m ggml-gpt4all-j-v1.3-groovy.bin -p "Rust is a cool programming language because", my basic idea for now is to change the Tauri app to let it do -p prompt, which receives from my code through the link or through a shared variable (if I don't use the link and start different times your app)

wonnx has done some fantastic work in this regard, so that's where we plan to start once we get there. In terms of general discussion of alternate backends, see this issue.

And are there any useful tool like this one, but for creating adventures and stories? https://zoltanai.github.io/character-editor/

You're gonna go here: https://zoltanai.github.io/character-editor/

- best possible parameter settings for chat/role play (temperature, Rep. Pen.,Min Length, Top K, Top, etc.) - world builder: How is this done? - extensions -> Objective: What can I do with it and how is it done -> examples? - best possible Pygmalion Model for Chat/Roleplay on a 8GB VRAM Card - the most important one: How to build a character? I use AI Character editor for the creation of bots. How to set up a character with it correctly for use in ST? Are there better ones? As a bonus: How does this all apply to characters used in oobabooga?

The editor is this one: https://zoltanai.github.io/character-editor/ About the collab, how does that work like, does it send you the same server or what it does?

How; most ai sites have a download or export option. If not you can typically copy and paste their info into a file creator like this one.

If you would like to create a character card, I would suggest using this site. It's fairly self explanatory. You can load your json files onto here. Alternatively, if you just have the info but no file then click new character and just fill in the information. Once you get to the export part, you'll want to save it as the tavern character card option. It'll save the file in the image so when you upload it on the site, it'll fill out all the fields with the info.

As /u/LienniTa mentioned, character cards are incredibly useful, even for non-RP uses. A lot of folks use chat interfaces not for the RP aspect, but for the fine control over kept-context. It's also nice to have a face to associate with your different chatbots. Here's an online character card creator I use to create cards.