Papers-in-100-Lines-of-Code
MTR
Papers-in-100-Lines-of-Code | MTR | |
---|---|---|
3 | 1 | |
582 | 9 | |
- | - | |
5.4 | 4.9 | |
3 days ago | 7 months ago | |
Python | Python | |
MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Papers-in-100-Lines-of-Code
-
How do I run this code from Papers in 100 lines of code?
I wanted to try the some code written by Maxime Vandegar https://github.com/MaximeVandegar/Papers-in-100-Lines-of-Code/tree/main/KiloNeRF_Speeding_up_Neural_Radiance_Fields_with_Thousands_of_Tiny_MLPs
- [P] Implementation of research papers (GANs, VAEs, 3d reconstruction, ...) in 100 lines of PyTorch code
- [P] Papers-in-100-Lines-of-Code: Implementation of research papers (GANs, VAEs, Meta-learning, 3d reconstruction, ...) in 100 lines of PyTorch code.
MTR
-
Rethinking Data Augmentation for Tabular Data in Deep Learning
Tabular data is the most widely used data format in machine learning (ML). While tree-based methods outperform DL-based methods in supervised learning, recent literature reports that self-supervised learning with Transformer-based models outperforms tree-based methods. In the existing literature on self-supervised learning for tabular data, contrastive learning is the predominant method. In contrastive learning, data augmentation is important to generate different views. However, data augmentation for tabular data has been difficult due to the unique structure and high complexity of tabular data. In addition, three main components are proposed together in existing methods: model structure, self-supervised learning methods, and data augmentation. Therefore, previous works have compared the performance without comprehensively considering these components, and it is not clear how each component affects the actual performance. In this study, we focus on data augmentation to address these issues. We propose a novel data augmentation method, $\textbf{M}$ask $\textbf{T}$oken $\textbf{R}$eplacement ($\texttt{MTR}$), which replaces the mask token with a portion of each tokenized column; $\texttt{MTR}$ takes advantage of the properties of Transformer, which is becoming the predominant DL-based architecture for tabular data, to perform data augmentation for each column embedding. Through experiments with 13 diverse public datasets in both supervised and self-supervised learning scenarios, we show that $\texttt{MTR}$ achieves competitive performance against existing data augmentation methods and improves model performance. In addition, we discuss specific scenarios in which $\texttt{MTR}$ is most effective and identify the scope of its application. The code is available at https://github.com/somaonishi/MTR/.
What are some alternatives?
EasyOCR - Ready-to-use OCR with 80+ supported languages and all popular writing scripts including Latin, Chinese, Arabic, Devanagari, Cyrillic and etc.
rtdl - Research on Tabular Deep Learning (Python package & papers) [Moved to: https://github.com/Yura52/rtdl]
taichi-ngp-renderer - An Instants-NGP renderer that has been implemented using Taichi
rtdl - Research on Tabular Deep Learning [Moved to: https://github.com/yandex-research/rtdl]
CelebV-HQ - [ECCV 2022] CelebV-HQ: A Large-Scale Video Facial Attributes Dataset
tabular-dl-pretrain-objectives - Revisiting Pretrarining Objectives for Tabular Deep Learning
rtdl-num-embeddings - (NeurIPS 2022) On Embeddings for Numerical Features in Tabular Deep Learning
nni - An open source AutoML toolkit for automate machine learning lifecycle, including feature engineering, neural architecture search, model compression and hyper-parameter tuning.
artbench - Benchmarking Generative Models with Artworks
pi-GAN-pytorch - Implementation of π-GAN, for 3d-aware image synthesis, in Pytorch
magic3d-pytorch - Implementation of Magic3D, Text to 3D content synthesis, in Pytorch
giraffe - This repository contains the code for the CVPR 2021 paper "GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fields"