karpathy/llm.c

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • JPEGDEC

    An optimized JPEG decoder for Arduino

  • JPEGDEC seems to be about 500 lines: https://github.com/bitbank2/JPEGDEC

  • llm.c

    LLM training in simple, raw C/CUDA

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • candle

    Minimalist ML framework for Rust

  • Candle already exists[1], and it runs pretty well. Can use both CUDA and Metal backends (or just plain-old CPU).

    [1] https://github.com/huggingface/candle

  • llm.f90

    LLM inference in Fortran

  • I'd like to think he took the name from my llm.f90 project https://github.com/rbitr/llm.f90

    It was originally based off of Karpathy's llama2.c but I renamed it when I added support for other architectures.

    Probable a coincidence :)

  • Time-LLM

    [ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

  • Yes general LLM models can be used for time series forecasting:

    https://github.com/KimMeen/Time-LLM

  • hidet

    An open-source efficient deep learning framework/compiler, written in python.

  • Check out Hidet [1]. Not as well funded, but delivers Python based ML acceleration with GPU support (unlike Mojo).

    [1] https://github.com/hidet-org/hidet

  • richard

    Richard is gaining power

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • rwkv.f90

    Port of the RWKV-LM model in Fortran (Back to the Future!)

  • I'm the creator behind https://github.com/nlpodyssey/rwkv.f90. How about joining forces?

  • picojpeg

    picojpeg: Tiny JPEG decoder for 8/16-bit microcontrollers

  • Most modern A/V codecs won't fit in that limit by several orders of magnitude.

    Even standard-compliant JPEG decoder would be hard to squeeze without some serious codegolfing. Discarding some barely used features gets you close to that limit, though [1].

    Smallest popular TCP/IP stack [2] is ~20kLoC.

    [1] https://github.com/richgel999/picojpeg

    [2] https://savannah.nongnu.org/projects/lwip/

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts