rtdl
TabTransformerTF
| rtdl | TabTransformerTF | |
|---|---|---|
| 5 | 2 | |
| 314 | 68 | |
| - | - | |
| 8.9 | 10.0 | |
| about 2 years ago | about 1 year ago | |
| Python | Jupyter Notebook | |
| MIT License | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
rtdl
-
[Project] Improving deep learning for tabular data with numerical embeddings (FT-Transformer)
Found relevant code at https://github.com/yandex-research/rtdl + all code implementations here
- [P] pytorch-widedeep v1.0.9: the Perceiver and the FastFormer for tabular data are now available in the library
- [P] pytorch-widedeep model alert: SAINT and the FT-Transformer are now available in the library
- [R] Revisiting Deep Learning Models for Tabular Data
TabTransformerTF
-
[Project] Improving deep learning for tabular data with numerical embeddings (FT-Transformer)
I've written a post that describes the numerical embeddings in more depth, looks at the explainability aspect, and shows how to train it with my tabtrasnformertf package. Here's a link if you're interested - https://towardsdatascience.com/improving-tabtransformer-part-1-linear-numerical-embeddings-dbc3be3b5bb5
-
[P] TabTransformer: Deep Dive w. Blog, Package & Notebook
To simplify the usage of the model, I've started working on TabTransformerTF package, but it's still WIP so feel free to report issues when you find some. Also, to showcase the use of the package, I've participated in the last month's tabular playground and got into top 35% with this notebook. Not great, but also not terrible given that the dataset was quite small and messy.
What are some alternatives?
tab-transformer-pytorch - Implementation of TabTransformer, attention network for tabular data, in Pytorch
pytorch-widedeep - A flexible package for multimodal-deep-learning to combine tabular data with text and images using Wide and Deep models in Pytorch
100DaysofMLCode - My journey to learn and grow in the domain of Machine Learning and Artificial Intelligence by performing the #100DaysofMLCode Challenge. Now supported by bright developers adding their learnings :+1:
ArtLine - A Deep Learning based project for creating line art portraits.
best_AI_papers_2021 - A curated list of the latest breakthroughs in AI (in 2021) by release date with a clear video explanation, link to a more in-depth article, and code.
tabnet - PyTorch implementation of TabNet paper : https://arxiv.org/pdf/1908.07442.pdf
rtdl-num-embeddings - (NeurIPS 2022) On Embeddings for Numerical Features in Tabular Deep Learning
creative-prediction - Creative Prediction with Neural Networks
rtdl-revisiting-models - (NeurIPS 2021) Revisiting Deep Learning Models for Tabular Data
machine-learning - 🤖 Repository with machine learning algorithms and implementations
tabular-dl-tabr - The implementation of "TabR: Unlocking the Power of Retrieval-Augmented Tabular Deep Learning"