BERT-Transformer-Pytorch
best-of-ml-python
BERT-Transformer-Pytorch | best-of-ml-python | |
---|---|---|
2 | 16 | |
39 | 15,633 | |
- | 2.6% | |
4.3 | 7.8 | |
4 months ago | 6 days ago | |
Python | Python | |
MIT License | Creative Commons Attribution Share Alike 4.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
BERT-Transformer-Pytorch
-
[P] Small problems to test out transformers?
The task is described in the paper I linked (3.1, Task #1: Masked LM). Any implementation of BERT should use it, like this one.
-
[D] [NLP] Did anything significant happen between RNN and transformer approaches?
There are many guides online, I wrote one here (it also refers to other tutorials). It comes with a python file with 300 lines of code re-implementing Transformers and Bert (it's hard to do shorter)
best-of-ml-python
-
Ask HN: How to get back into AI?
For Python, here's a nice compilation: https://github.com/ml-tooling/best-of-ml-python/blob/main/RE...
- Best-Of Machine Learning with Python
-
Questions regarding Job Requirements for data analyst to data science transition?
You will need numpy, scipy, pandas, scikit-learn, Keras/tensorflow/pytorch, xgboost and many many many others. See this list for example.
- Awesome list of ML
- Are there any speech recognition modules so I can write one and do not have to rely on google and the likes?
-
Learning opencv
Take a look at this list on github. It has a pretty comprehensive list of python image libraries.
- Best-of Machine Learning with Python
- 🏆 A ranked list of awesome machine learning Python libraries. Updated weekly.
What are some alternatives?
minGPT - A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training
Awesome-WAF - 🔥 Web-application firewalls (WAFs) from security standpoint.
ktrain - ktrain is a Python library that makes deep learning and AI more accessible and easier to apply
dtale - Visualizer for pandas data structures
ffcv - FFCV: Fast Forward Computer Vision (and other ML workloads!)
awesome-python - An opinionated list of awesome Python frameworks, libraries, software and resources.
kmodes - Python implementations of the k-modes and k-prototypes clustering algorithms, for clustering categorical data
NBA-Machine-Learning-Sports-Betting - NBA sports betting using machine learning
livelossplot - Live training loss plot in Jupyter Notebook for Keras, PyTorch and others
speechbrain - A PyTorch-based Speech Toolkit
VeRyPy - A python library with implementations of 15 classical heuristics for the capacitated vehicle routing problem.
ydata-profiling - 1 Line of code data quality profiling & exploratory data analysis for Pandas and Spark DataFrames.