gpt-2 VS gpt-2

"Our model, called GPT-2 (a successor to GPT), was trained simply to predict the next word in 40GB of Internet text. Due to our concerns about malicious applications of the technology, we are not releasing the trained model. As an experiment in responsible disclosure, we are instead releasing a much smaller model for researchers to experiment with, as well as a technical paper. "

They did release GPT-2 under the MIT License.

Did you arrive at this certainty through reading something other than what OpenAI has published? The document [0] that describes the training data for GPT-2 makes this assertion hilarious to me.

[0]: https://github.com/openai/gpt-2/blob/master/model_card.md#da...

I made a clone of https://github.com/openai/gpt-2 on my local laptop

Elon's 100M put this in the arena. https://github.com/openai/gpt-2

I'm following this https://github.com/nshepperd/gpt-2 repo to fine tune the gpt-2 355M model, i've collected (comment,code) pairs from github into a text file where data have the following format :

I then put all the submissions and comments in a txt file in an order mimicking reddit’s “sort by top”, and fine-tuned for each subreddit using GPT-345M, specifically nsheppard's GPT implementation. This tutorial written by u/gwern provided very helpful guidance as well.