Top 3 Python associative-memory Projects

heinsen_routing

7 160 2.7 Python

Reference implementation of "An Algorithm for Routing Vectors in Sequences" (Heinsen, 2022) and "An Algorithm for Routing Capsules in All Domains" (Heinsen, 2019), for composing deep neural networks.

Project mention: What can LLMs never do? | news.ycombinator.com | 2024-04-27

At one point I experimented a little with transformers that had access to external memory searchable via KNN lookups https://github.com/lucidrains/memorizing-transformers-pytorc... or via routed queries with https://github.com/glassroom/heinsen_routing . Both approaches seemed to work for me, but I had to put that work on hold for reasons outside my control.

deep-implicit-attention

1 60 0.0 Python

Implementation of deep implicit attention in PyTorch
InfluxDB

www.influxdata.com featured

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
spin-model-transformers

1 25 7.6 Python

Physics-inspired transformer modules based on mean-field dynamics of vector-spin models in JAX

Project mention: [P] Spin-Model Transformers | /r/MachineLearning | 2023-12-06

Code (JAX): https://github.com/mcbal/spin-model-transformers

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).