How to Build an AI Text Generator: Text Generation with a GPT-2 Model

• transformers

  176 125,369 10.0 Python

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  

To fine-tune a pre-trained model, we could use the run_langauge_modeling.py. All we need are two text files; one containing the training text pieces, and another containing the text pieces for evaluation.

• Towards-A-Deep-and-Unified-Understanding-of-Deep-Neural-Models-in-NLP

  1 68 0.0 Jupyter Notebook

  Code implementation of paper Towards A Deep and Unified Understanding of Deep Neural Models in NLP

In Towards a Deep and Unified Understanding of Deep Neural Models in NLP, the authors propose a way to answer this. They also provide the code that we could use to analyze the GPT-2 model with.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• bertviz

  15 6,398 3.9 Python

  BertViz: Visualize Attention in NLP Models (BERT, GPT2, BART, etc.)

Thanks to jessevig’s BertViz tool, we can peek at how GPT-2 works by visualizing the attention values.

Suggest a related project