[P] Small problems to test out transformers?

• minGPT

  35 18,981 0.0 Python

  A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

Andrej Karpathy uses this task in his minGPT repo.

• BERT-Transformer-Pytorch

  2 39 4.3 Python

  Basic implementation of BERT and Transformer in Pytorch in one short python file (also includes "predict next word" GPT task)

The task is described in the paper I linked (3.1, Task #1: Masked LM). Any implementation of BERT should use it, like this one.

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project