The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning. Learn more →
Top 23 Rust openai Projects
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
aichat
All-in-one AI-Powered CLI Chat & Copilot that integrates 10+ AI platforms, including OpenAI, Azure-OpenAI, Gemini, VertexAI, Claude, Mistral, Cohere, Ollama, Ernie, Qianwen...
-
llm-chain
`llm-chain` is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
-
-
-
signway
Bring the power of pre-signed URLs to your apps. Signway is a gateway for redirecting ephimeral signed URLs to the requested API
-
gpt-cli
Run linux commands with natural language. Eg.: "show my graphic card" instead "lspci | grep VGA" (by gustawdaniel)
-
-
openai-client
OpenAI Dive is an unofficial async Rust library that allows you to interact with the OpenAI API.
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Project mention: What AI assistants are already bundled for Linux? | news.ycombinator.com | 2024-03-01> I wouldn't hold my breath waiting for a native Linux AI-assisted assistant.
On Mac when I press Command + Space, it brings up Spotlight search
That can't easily be added to be the equivalent of some kind of LLM prompt on GNOME/KDE/XFCE?
I don't quite know what you'd ask it/do with it that would be of much value? Seems like a quicker way/a wrapper around either asking an LLM questions via CLI or basically Electron wrapping HTML (like this https://github.com/lencx/ChatGPT)?
Project mention: Pake – Turn any webpage into a desktop app with Rust | news.ycombinator.com | 2023-11-29
Project mention: Show HN: A shell CLI tool to predict your next command enhanced by LLM and RAG | news.ycombinator.com | 2024-04-16thanks for sharing this, I have been using aichat (https://github.com/sigoden/aichat) and shell_gpt for a while. Let's see how it works.
Project mention: Smartgpt: A program that provides LLMs ability with complex tasks using plugins | news.ycombinator.com | 2023-08-28
Project mention: are there anytools or frameworks similar to "langchain" or "llamaindexbut implemented or designed in a language other than python? | /r/LocalLLaMA | 2023-06-28
I am trying to stream a response from the OpenAI API as an SSE with axum. I have combined the following examples from the async-openai and axum repos to produce the below code I've used iterators in Rust but have not used streams, I have no idea how to reconcile the types here and don't know where to start to solve the problem. A solution or any pointers would be greatly appreciated. https://github.com/tokio-rs/axum/tree/axum-v0.6.20/examples/sse https://github.com/64bit/async-openai/tree/main/examples/chat-stream ``rust async fn sse_handler( TypedHeader(user_agent): TypedHeader, ) -> Sse>> { println!("{}` connected", user_agent.as_str());
Project mention: Opentau – Using Large Language Models for Gradual Type Inference | news.ycombinator.com | 2023-08-13
Project mention: Show HN: Signed URLs Gateway – The Missing Infra Piece for Building Modern Apps | news.ycombinator.com | 2023-11-20
Project mention: NEW AI Rust Tool to Create Prototypes With a single Prompt! | no more copy paste! | /r/rust | 2023-05-12Open Source: https://github.com/security-union/code-muse-rs
Project mention: Show HN: Cai – The fastest CLI tool for prompting LLMs | news.ycombinator.com | 2024-03-28
Project mention: Show HN: Auto-Pilot-Computer – Let GPT4 vision operate your computer | news.ycombinator.com | 2023-12-18
Project mention: Go, Python, Rust, and production AI applications | news.ycombinator.com | 2024-03-12I switched from python to rust for my AI stuff. Honestly, I don't care about the things people say rust is used for. I like it because the package manager, testing, and typings being built into the ecosystem by default makes it so easy to build. VS Python where it all can be done, but you need to then maintain all of those separate tools. The overhead of writing Rust is less than the overhead of dealing with the Python ecosystem. And then you have all the benefits of Rust everyone mentions more often... one other thing no one mentions is the feedback loop between a strongly typed language and copilots ability to more accurately generate code.
That being said, there is a real shortage of Rust software for Rust only projects. I ended up writing a wrapper for Llama.cpp and open ai API [0] because I needed it and couldn't find anything out there. Eventually, I do intend to implement Hugging Face's Candle library [1] (A rust version of Torch). There is something appealing about doing everything in a single lang especially as the monopoly of CUDA inevitably gets chipped away.
[0] https://github.com/ShelbyJenkins/llm_client
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
Rust openai related posts
- Show HN: Signed URLs Gateway – The Missing Infra Piece for Building Modern Apps
- Proper type for axum SSE stream
- Smartgpt: A program that provides LLMs ability with complex tasks using plugins
- SmartGPT: Major Benchmark Broken – 89.0% on MMLU and Exam Errors [video]
- Opentau – Using Large Language Models for Gradual Type Inference
- are there anytools or frameworks similar to "langchain" or "llamaindexbut implemented or designed in a language other than python?
- Show HN: Signway – An open source pre-signed URLs gateway written in Rust
-
A note from our sponsor - WorkOS
workos.com | 29 Apr 2024
Index
What are some of the best open-source openai projects in Rust? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | ChatGPT | 46,892 |
| 2 | Pake | 22,876 |
| 3 | aichat | 2,804 |
| 4 | chat-ai-desktop | 1,953 |
| 5 | smartgpt | 1,726 |
| 6 | llm-chain | 1,156 |
| 7 | async-openai | 947 |
| 8 | ai00_server | 377 |
| 9 | rusty | 322 |
| 10 | ata | 268 |
| 11 | tiktoken-rs | 200 |
| 12 | opentau | 90 |
| 13 | signway | 78 |
| 14 | gpt-cli | 69 |
| 15 | houston | 52 |
| 16 | code-muse-rs | 40 |
| 17 | openai-client | 35 |
| 18 | rustgpt | 30 |
| 19 | cai | 28 |
| 20 | summarize | 27 |
| 21 | auto-pilot-computer | 27 |
| 22 | llm_client | 18 |
| 23 | libopenai | 13 |
Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com