SaaSHub helps you find the best software and product alternatives Learn more →
Top 14 Python Architecture Projects
-
Professional Programming by Charles-Axel Dein
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
-
代码中的图表
-
-
TokenFormer
Official Implementation of TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters
Project mention: Tokenformer: Rethinking transformer scaling with tokenized model parameters | news.ycombinator.com | 2024-10-31Transformers have become the predominant architecture in foundation models due to their excellent performance across various domains. However, the substantial cost of scaling these models remains a significant concern. This problem arises primarily from their dependence on a fixed number of parameters within linear projections. When architectural modifications (e.g., channel dimensions) are introduced, the entire model typically requires retraining from scratch. As model sizes continue growing, this strategy results in increasingly high computational costs and becomes unsustainable. To overcome this problem, we introduce Tokenformer, a natively scalable architecture that leverages the attention mechanism not only for computations among input tokens but also for interactions between tokens and model parameters, thereby enhancing architectural flexibility. By treating model parameters as tokens, we replace all the linear projections in Transformers with our token-parameter attention layer, where input tokens act as queries and model parameters as keys and values. This reformulation allows for progressive and efficient scaling without necessitating retraining from scratch. Our model scales from 124M to 1.4B parameters by incrementally adding new key-value parameter pairs, achieving performance comparable to Transformers trained from scratch while greatly reducing training costs. Code and models are available at https://github.com/Haiyang-W/TokenFormer
-
I'll demonstrate how combine those two by building one or more applications using Python polylith in the repository https://github.com/ybenitezf/ca-todo-app
-
diagrams-as-code
Diagrams as code: declarative configurations using YAML for drawing cloud system architectures.
-
MeasureIt_ARCH
MeasureIt_ARCH is an addon for Blender, that adds tools to create design documentation and technical drawings that can be previewed within Blender's 3D viewport, and exported as images, vector graphics or .dxf files. Read the Doc's here:
-
maxim-pytorch
[CVPR 2022 Oral] PyTorch re-implementation for "MAXIM: Multi-Axis MLP for Image Processing", with *training code*. Official Jax repo: https://github.com/google-research/maxim
-
-
-
-
-
Haruhi-Suzumiya-3D-School
3D recreation of Haruhi Suzumiya's highschool in great detail, free of use to anyone.
-
Python Architecture discussion
Python Architecture related posts
-
Create Architecture Diagram as Code for a 2-Tier Bookstore Application
-
Diagrams as Code
-
Ask HN: Looking for a project to volunteer on? (January 2024)
-
ECS in practice with python lib - ecs_pattern
-
Top 9 Architecture diagram software for cloud infrastructure
-
Diagrams as code: declarative YAML configuration for drawing cloud architectures
-
[Golang] Diagrammes comme code avec Go?
-
A note from our sponsor - SaaSHub
www.saashub.com | 3 Dec 2024
Index
What are some of the best open-source Architecture projects in Python? This list will help you:
Project | Stars | |
---|---|---|
1 | professional-programming | 46,783 |
2 | diagrams | 39,785 |
3 | PyTorch-VAE | 6,716 |
4 | TokenFormer | 392 |
5 | python-polylith | 382 |
6 | diagrams-as-code | 330 |
7 | MeasureIt_ARCH | 269 |
8 | maxim-pytorch | 169 |
9 | cairis | 149 |
10 | pumla | 105 |
11 | pytest-archon | 62 |
12 | ecs_pattern | 40 |
13 | Haruhi-Suzumiya-3D-School | 16 |
14 | python-architecture-linter | 11 |