neural-network-from-scratch
Seed
Our great sponsors
neural-network-from-scratch | Seed | |
---|---|---|
3 | 36 | |
114 | 3,786 | |
- | 0.1% | |
0.0 | 4.2 | |
about 2 years ago | 8 months ago | |
Rust | Rust | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
neural-network-from-scratch
- Examine individual neurons of a small neural network in the browser
-
Language models can explain neurons in language models
I built a toy neural network that runs in the browser[1] to model 2D functions with the goal of doing something similar to this research (in a much more limited manner, ofc). Since the input space is so much more limited than language models or similar, it's possible to examine the outputs for each neuron for all possible inputs, and in a continuous manner.
In some cases, you can clearly see neurons that specialize to different areas of the function being modeled, like this one: https://i.ameo.link/b0p.png
This OpenAI research seems to be feeding lots of varied input text into the models they're examining and keeping track of the activations of different neurons along the way. Another method I remember seeing used in the past involves using an optimizer to generate inputs that maximally activate particular neurons in vision models[2].
I'm sure that's much more difficult or even impossible for transformers which operate on sequences of tokens/embeddings rather than single static input vectors, but maybe there's a way to generate input embeddings and then use some method to convert them back into tokens.
[1] https://nn.ameo.dev/
[2] https://www.tensorflow.org/tutorials/generative/deepdream
-
Browser-based neural network sandbox built with Rust + WebAssembly
Full source code is on Github: https://github.com/ameobea/neural-network-from-scratch
Seed
-
Yew alternatives
Practically every Rust web frontend I've seen takes a react-like approach, with "hooks" to store all of the state in. The now-abandoned Seed and Yew's struct components use a message-passing approach, where the state is stored as member variables on the struct representing the component that are updated based on messages dispatched by event handlers. There's also egui, which has a completely different paradigm that involves making the UI from scratch every frame based on the app's current state. It's not a web framework the same way as the others, but it can draw its UI to a web canvas just fine.
-
Want a web app to respond to local file changes. Is Tauri the solution here?
Sycamore, Yew, or Seed if you want a full-stack solution. (Or Leptos if you want something that's faster but less mature.)
-
Full-stack authentication system using rust (actix-web) and sveltekit
An authentication system is an integral part of modern applications. It's so important that almost all modern applications have some sort of it. Because of their critical nature, such systems should be secure and should follow OWAP®'s recommendations on web security and password hashing as well as storage to prevent attacks such as Preimage and Dictionary attacks (common to SHA algorithms). To demonstrate some of the recommendations, we'll be building a robust session-based authentication system in Rust and a complementary frontend application. For this article series, we'll be using Rust's actix-web and some awesome crates for the backend service. SvelteKit will be used for the frontend. It should be noted however that what we'll be building is largely framework agnostic. As a result, you can decide to opt for axum, rocket, warp or any other rust's web framework for the backend and react, vue or any other javascript framework for the frontend. You can even use rust's yew, seed or some templating engines such as MiniJinja or tera at the frontend. It's entirely up to you. Our focus will be more on the concepts.
-
Rust tech stack
If you want to do fullstack/SPA stuff, check out Sycamore, Seed, and Yew.
-
rust web dev??
If you want to do front-end SPA development, take a look at Yew, Seed, or Sycamore.
-
Blazor United - When it ships it would be the most glorious way to do web with .NET
Aside from Blazor there's already some other projects like Yew (rust), seed (rust), asm-dom (C++) and vugu (Go) and more that have decent followings and activity. A lot more (especially managed languages) are waiting for some features to come online like wasm GC and host bindings (direct wasm access to browser apis which includes the DOM). It'll take a bit of time, but it'll get there eventually.
-
Recommended web-app framework for newbies and juniors?
To click * https://crates.io/crates/percy * https://crates.io/crates/seed * https://crates.io/crates/perseus * https://crates.io/crates/sycamore
-
Back to School: Free Rust Courses
For desktop apps maybe check out Tauri . You can use it with a lot of (web)frontend options including yew/wasm (also Seed ) if you want to go 100% Rust. Actix and Rocket are options for web framework. Also have look at the Building a Command Line Program in the book. I found it really helpful since i am just starting to learn myself.
- Tauri – Creating Tiny Desktop Apps
-
They interviewed the founder of a full-stack Rust framework called "MoonZoon" in this newsletter. Has anyone here used MoonZoon before?
I haven't been keeping up with it, but have heard of it. If ibrecall correctly it was created by the developer that initially developed seed (https://seed-rs.org/)
What are some alternatives?
shorelark - Simulation of life & evolution
yew - Rust / Wasm framework for creating reliable and efficient web applications
wasm-pdf - Generate PDF files with JavaScript and WASM (WebAssembly)
Rocket - A web framework for Rust.
bhtsne - Parallel Barnes-Hut t-SNE implementation written in Rust.
rust-dominator - Zero-cost ultra-high-performance declarative DOM library using FRP signals for Rust!
wasm-learning - Building Rust functions for Node.js to take advantage of Rust's performance, WebAssembly's security and portability, and JavaScript's ease-of-use. Demo code and recipes.
sauron - A versatile web framework and library for building client-side and server-side web applications
minesweeper - Minesweeper game developed with Rust, WebAssembly (Wasm), and Canvas
percy - Build frontend browser apps with Rust + WebAssembly. Supports server side rendering.
bitque - A simplified Jira clone built with seed.rs and actix
sycamore - A library for creating reactive web apps in Rust and WebAssembly