neural-network-from-scratch

A neural network library written from scratch in Rust along with a web-based application for building + training neural networks + visualizing their outputs (by Ameobea)

Neural-network-from-scratch Alternatives

Similar projects and alternatives to neural-network-from-scratch

neural-network-from-scratch
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better neural-network-from-scratch alternative or higher similarity.

neural-network-from-scratch discussion

Log in or Post with

neural-network-from-scratch reviews and mentions

Posts with mentions or reviews of neural-network-from-scratch. We have used some of these posts to build our list of alternatives and similar projects.
  • Examine individual neurons of a small neural network in the browser
    1 project | news.ycombinator.com | 10 May 2023
  • Language models can explain neurons in language models
    1 project | news.ycombinator.com | 9 May 2023
    I built a toy neural network that runs in the browser[1] to model 2D functions with the goal of doing something similar to this research (in a much more limited manner, ofc). Since the input space is so much more limited than language models or similar, it's possible to examine the outputs for each neuron for all possible inputs, and in a continuous manner.

    In some cases, you can clearly see neurons that specialize to different areas of the function being modeled, like this one: https://i.ameo.link/b0p.png

    This OpenAI research seems to be feeding lots of varied input text into the models they're examining and keeping track of the activations of different neurons along the way. Another method I remember seeing used in the past involves using an optimizer to generate inputs that maximally activate particular neurons in vision models[2].

    I'm sure that's much more difficult or even impossible for transformers which operate on sequences of tokens/embeddings rather than single static input vectors, but maybe there's a way to generate input embeddings and then use some method to convert them back into tokens.

    [1] https://nn.ameo.dev/

    [2] https://www.tensorflow.org/tutorials/generative/deepdream

  • Browser-based neural network sandbox built with Rust + WebAssembly
    1 project | /r/rust | 2 Apr 2022
    Full source code is on Github: https://github.com/ameobea/neural-network-from-scratch
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 21 Jul 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Stats

Basic neural-network-from-scratch repo stats
3
121
0.0
over 2 years ago

Sponsored
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com