bart-base-jax
NLP-Model-for-Corpus-Similarity
bart-base-jax | NLP-Model-for-Corpus-Similarity | |
---|---|---|
1 | 1 | |
27 | 9 | |
- | - | |
1.4 | 0.0 | |
about 1 year ago | almost 4 years ago | |
Python | Python | |
- | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bart-base-jax
-
How we created an in-browser BERT attention visualiser without a server - TrAVis: Transformer Attention Visualiser
Firstly, we implemented the BART model from scratch using JAX. We chose JAX because it is an amazing deep learning framework that enables us to write clear source code, and it can be easily converted to NumPy, which can be executed in-browser. We chose the #BART model because it is a complete encoder-decoder model, so it can be easily adapted to other models, such as BERT, by simply taking a subset of the source code.
NLP-Model-for-Corpus-Similarity
What are some alternatives?
word-piece-tokenizer - A Lightweight Word Piece Tokenizer
dtale - Visualizer for pandas data structures
jax - Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more
Probabilistic-Programming-and-Bayesian-Methods-for-Hackers - aka "Bayesian Methods for Hackers": An introduction to Bayesian methods + probabilistic programming with a computation/understanding-first, mathematics-second point of view. All in pure Python ;)
TrAVis - TrAVis: Visualise BERT attention in your browser
StringDistances.jl - String Distances in Julia
d3 - Bring data to life with SVG, Canvas and HTML. :bar_chart::chart_with_upwards_trend::tada:
wordview - A Python package for Exploratory Data Analysis (EDA) for text-based data.
bert - TensorFlow code and pre-trained models for BERT