LLM Visualization

• minGPT

  35 18,875 0.0 Python

  A minimal PyTorch re-implementation of the OpenAI GPT (Generative Pretrained Transformer) training

This is an excellent tool to realize how an LLM actually works from the ground up!

For those reading it and going through each step, if by chance you get stuck on why 48 elements are in the first array, please refer to the model.py on minGPT [1]

It's an architectural decision that it will be great to mention in the article since people without too much context might lose it

[1] https://github.com/karpathy/minGPT/blob/master/mingpt/model....

• llm-viz

  5 2,476 8.7 TypeScript

  3D Visualization of an GPT-style LLM

I big kudos to the author of this.

Not only has the visualization, but it's interactive, has explanations for each item, and is open source: https://github.com/bbycroft/llm-viz

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project