Transformer-in-Transformer
principia
| Transformer-in-Transformer | principia | |
|---|---|---|
| 4 | 10 | |
| 41 | 198 | |
| - | - | |
| 0.0 | 2.7 | |
| about 2 years ago | 10 months ago | |
| Jupyter Notebook | TeX | |
| Apache License 2.0 | GNU General Public License v3.0 only |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Transformer-in-Transformer
- I Implemented Transformer in Transformer
-
Hacker News top posts: Dec 6, 2021
I Implemented Transformer in Transformer\ (5 comments)
- [P] I implemented Transformer in Transformer
principia
-
Principia Mathematica in modern notation.
You can check it out here: https://www.principiarewrite.com/
-
It took Russell and that other guy 360 pages to prove that 1+1=2. That's how rigorous math is.
It's crazy to think that we didn't really know for sure whether 1+1=2 until ~1910, yet it's true. That's when Bernard Russell (best known for Russell's teapot, exposing a logical fallacy in Christianity) and some other dude actually proved it from axioms. They laid out the foundation of 1+1 in a book called Principia Mathematica. They worked so rigorously that it took them 360 pages to even prove something as basic as 1+1=2 using the axiomatic method. If you want to use a modern tool like Coq to verify 1+1=2, then the best way of doing this is to formalize Principia Mathematica in Coq.
-
Which is the most abstract and bizzare book of mathematics you have ever came across?
There are people trying to make it more readable.
-
Ask HN: Would prog. language look like if that was designed by no-programmer
Principia
A work from the early 20th century, mathematics, logic.
I think some expert called Bertrand Russell's and A.N. Whitehead's "Principia Mathematica" initiative a "bizarre" piece of work, when seen from the perspective of a programming language designer.
I can't make a qualified statement about this, as I am neither a mathematician nor a language designer. And I cannot find the exact quote on the internet, sorry. Just saying.
In code? See for yourself :
https://www.principiarewrite.com/
-
Hacker News top posts: Dec 6, 2021
Whitehead and Russell’s Principia rewritten in Coq\ (44 comments)
- Whitehead and Russell’s Principia rewritten in Coq
- The Principia Rewrite: Whitehead and Russell’s Principia Rewritten in Coq
What are some alternatives?
poolformer - PoolFormer: MetaFormer Is Actually What You Need for Vision (CVPR 2022 Oral)
Coq-Equations - A function definition package for Coq
LongNet - Implementation of plug in and play Attention from "LongNet: Scaling Transformers to 1,000,000,000 Tokens"
hs-to-coq - Convert Haskell source code to Coq source code.
AvatarGAN - Generate Cartoon Images using Generative Adversarial Network
inform7-ide - A design system for interactive fiction based on natural language.
swarms - Orchestrate Swarms of Agents From Any Framework Like OpenAI, Langchain, and Etc for Real World Workflow Automation. Join our Community: https://discord.gg/DbjBMJTSWD
cycle-cloud - Repository to allow collaboration between Cycle Labs Cloud community in support of the community.
planckforth - Bootstrapping a Forth interpreter from hand-written tiny ELF binary. Just for fun.
mathlib - Lean 3's obsolete mathematical components library: please use mathlib4
Fast-Transformer - An implementation of Fastformer: Additive Attention Can Be All You Need, a Transformer Variant in TensorFlow