-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
The model is made by Facebook, but it is released publicly and anybody can run it. You can download it and run it on your own machine (if you have the hardware and technical skill, which the vast majority of people probably do not.) You can get it from GitHub here: https://github.com/pytorch/fairseq/blob/master/examples/megatron_11b/README.md
Okay. So, here's the thing. Honestly, I don't know how to wire megatron into GPT-2 (like I said)—and I tried. I knew that it is done, and I could find discussions about it in other projects (e.g. https://github.com/huggingface/transformers/issues/9560 ) but since AI isn't my domain and I don't know jack about the relevant methodologies and libraries beyond the broadest broad strokes, I wasn't able to put it together.