ort
Graphite
Our great sponsors
ort | Graphite | |
---|---|---|
7 | 46 | |
555 | 6,831 | |
14.6% | 22.1% | |
9.3 | 9.6 | |
9 days ago | 7 days ago | |
Rust | Rust | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ort
-
AI Inference now available in Supabase Edge Functions
To solve this, we built a native extension in Edge Runtime that enables using ONNX runtime via the Rust interface. This was made possible thanks to an excellent Rust wrapper called Ort:
-
AI Inference Now Available in Supabase Edge Functions
hey hn, supabase ceo here
As the post points out, this comes in 2 parts:
1. Embeddings models for RAG workloads (specifically pgvector). Available today.
2. Large Language Models for GenAI workloads. This will be progressively rolled out as we get our hands on more GPUs.
We've always had a focus on architectures that can run anywhere (especially important for local dev and self-hosting). In that light, we've found that the Ollama[0] tooling is really unbeatable. I heard one of our engineers explain it like "docker for models" which I think is apt.
To support models that work best with GPUs, we're running them with Fly GPUs - pretty much this: https://fly.io/blog/scaling-llm-ollama (and then we stitch a native API around it). The plan is that you will be able to "BYO" model server and point the Edge Runtime towards it using simple env vars / config.
We've also made improvements for CPU models. We built a native extension in Edge Runtime that enables using ONNX runtime via the Rust interface. This was made possible thanks to an excellent Rust wrapper, Ort[1]. We have the models stored on disk, so there is no downloading, cold-boot, etc.
The thing I most like about this set up is that you can now use Edge Functions like background workers for your Postgres database, offloading heavy compute for generating embeddings. For example, you can trigger the worker when a user inserts some text, and then the worker will asynchronously create the embedding and store it back into your database.
I'll be around if there are any questions.
[0] ollama.com
[1] Ort: https://github.com/pykeio/ort
-
Moving from Typescript and Langchain to Rust and Loops
In the quest for more efficient solutions, the ONNX runtime emerged as a beacon of performance. The decision to transition from Typescript to Rust was an unconventional yet pivotal one. Driven by Rust's robust parallel processing capabilities using Rayon and seamless integration with ONNX through the ort crate, Repo-Query unlocked a realm of unparalleled efficiency. The result? A transformation from sluggish processing to, I have to say it, blazing-fast performance.
-
How to create YOLOv8-based object detection web service using Python, Julia, Node.js, JavaScript, Go and Rust
ort - ONNX runtime library.
-
Do you use Rust in your professional career?
Our main model in Rust is a deep neural network, using ONNX via the ort rust bindings. The application is some particular applications of process automation.
-
onnxruntime
You could try ort https://github.com/pykeio/ort It looks like it's in active development and supports GPU inference
-
Deep Learning in Rust: Burn 0.4.0 released and plans for 2023
I would't try to distribute your ml models with the typical frameworks, especially not with python. Have you looked in to ONNX?For example: https://github.com/pykeio/ort
Graphite
- 3D and 2D: Testing out my cross-platform graphics engine
-
Canva acquires Affinity, its biggest acquisition, to compete with Adobe
There is also Graphite (https://graphite.rs/) which, unlike Gimp, has a modern architecture and very ambitious goals (Blender for 2D basically).
-
Any good beginner open source projects for a guy with a math background?
If you're interested in either computational geometry, layout/packing/constraints, or functional programming language concepts, those are all the math-related concepts that we're currently interacting with for Graphite, a 2D vector graphics editor that's aiming to become the next Blender (but for 2D instead of 3D). If that sounds interesting, I'd love to help get you started if you want to join our Discord and I can explain the math-related work that we need to get done. Cheers!
- Graphite: 2D Raster and Vector Editor
-
Things I wish I knew before moving 50K lines of code to React Server Components
Not sure which web-based spreadsheet app you're talking about, because there are many that do use these frameworks. Here's a PS/AI clone built with a Svelte frontend: https://graphite.rs
- Redefining state-of-the-art graphics editing
- Graphite: Open-source raster and vector 2D graphics editor
- Graphite: In-development raster and vector 2D graphics editor that is FOSS
-
Whatβs everyone working on this week (25/2023)?
Wanted to contribute to a good Rust-based project last week, started searching and found a good Reddit thread featuring several great projects. Looked at and found Graphite. I liked the concept though I know almost nothing about graphic design.
-
New release for the Rust diffusers crate (Stable Diffusion in Rust + Torch), now with basic ControlNet support!
I'm currently trying to decide on the SD server to deploy with Graphite, both for running locally (with Tauri desktop builds) and for us to host on a server for users.
What are some alternatives?
onnxruntime-rs - Rust wrapper for Microsoft's ONNX Runtime (version 1.8)
egui - egui: an easy-to-use immediate mode GUI in Rust that runs on both web and native
yolov8_onnx_go - YOLOv8 Inference using Go
Method-Draw - Method Draw, the SVG Editor for Method of Action
onnxruntime-php - Run ONNX models in PHP
GimelStudio - Non-destructive, node based 2D image editor with an API for custom nodes
yolov8_onnx_javascript - YOLOv8 inference using Javascript
Gimel-Studio - Old repo of the node-based image editor. See https://github.com/GimelStudio/GimelStudio for the next generation of Gimel Studio :rocket:
langchainjs - π¦π Build context-aware reasoning applications π¦π
bevy - A refreshingly simple data-driven game engine built in Rust
yolov8_onnx_julia - YOLOv8 inference using Julia
burn - Burn is a new comprehensive dynamic Deep Learning Framework built using Rust with extreme flexibility, compute efficiency and portability as its primary goals. [Moved to: https://github.com/Tracel-AI/burn]