post--activation-atlas

Using feature inversion to visualize millions of activations from an image classification network, we create an explorable activation atlas of features the network has learned which can reveal how the network typically represents some concepts. (by distillpub)

Post--activation-atlas Alternatives

Similar projects and alternatives to post--activation-atlas

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better post--activation-atlas alternative or higher similarity.

post--activation-atlas reviews and mentions

Posts with mentions or reviews of post--activation-atlas. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2022-05-07.
  • Exploring Neural Networks with Activation Atlases
    1 project | /r/ArtificialLearningFan | 4 May 2023
  • representation = feature ?
    1 project | /r/MLQuestions | 9 Apr 2023
    i encourage you to try and think about it more as "features are a kind of representation" than "a representation is a collection of features". when I hear the word "features", that suggests to me that each component of the vector is a feature. that's often not how it will work in deep learning. instead what you get is a set of coordinates, a position in a kind of "semantic space" where we expect two sets of coordinates to be near each other if the things they represent are similar.
  • How neural network recognise a dog.
    1 project | /r/learnmachinelearning | 22 Nov 2022
  • Xilem: An Architecture for UI in Rust
    10 projects | news.ycombinator.com | 7 May 2022
    Okay. That said, are there any particular conclusions or implications from this approach for that use case?

    For that matter, are you next going to extend this simple exploration toward more complexity (eg. more widget types, more interactions, more layout constraints, etc.) or toward more data?

    As I've followed your efforts in this area, the power and utility of selecting the right motivating example has been coming into focus. The parallels with a startup's MVP are fairly clear, the parallels to selecting a (dissertation) research topic a bit handwavy (in part because guidelines for the latter are extraordinarily vague). So far you haven't really chosen a new motivating end-user application since suspending development of Xi. There are lots of directions you could go, from making an equivalent to Processing, to creating a game engine, or eventually restarting Xi development with an eye toward exploration and visualization of large codebases, etc. Personally I'm starting to become intrigued by the need to dig into large neural nets and the representations encoded within (related subtopics: latent spaces, feature vectors, orthogonality):

    https://distill.pub/2019/activation-atlas/

    Meanwhile, I've been casting about for a proper (Rust) motivating example app/library of my own, and the closest I've come so far is something like a HTML + CSS rendering engine, though not targeted at the Web per-se, but instead at ebooks (esp. EPUB), a much smaller set of required functionality.

    In theory a desktop ebook library + reader app with features like MathML support, advanced typography, and visualizing connections between millions of works and annotations seems like it would be a better fit with the direction you're (currently) going than any existing framework.

  • Why is it hard to understand why an AI finds a pattern?
    1 project | /r/ArtificialInteligence | 6 Dec 2021
    This is probably over your head technically but checkout the cool graphics! It’s basically showing a glimpse into how AI recognizes pictures. https://distill.pub/2019/activation-atlas/
  • Art and AI, special thanks to Mitchell Farley and GOOGLE ML and AI links online:
    1 project | /r/u_mwickerson | 1 Mar 2021
  • High-Low Frequency Detectors
    1 project | news.ycombinator.com | 28 Jan 2021
    Here’s an example of peer review on GitHub from an older article: https://github.com/distillpub/post--activation-atlas/issues?...

    In general on the Distill front page there are “peer-review” badges that link to the GitHub issues containing the reviews.

  • A note from our sponsor - SurveyJS
    surveyjs.io | 26 Apr 2024
    With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js. Learn more →

Stats

Basic post--activation-atlas repo stats
7
42
0.0
almost 4 years ago

The primary programming language of post--activation-atlas is JavaScript.


Sponsored
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com