C++ GPT-2 inference engine

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com
gpt-2 inference-engine Zig

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • a1gpt

    throwaway GPT inference

  • zig_gpt2

    GPT-2 inference engine written in Zig

    • This is pretty cool. I had the same idea but in zig: https://github.com/EugenHotaj/zig_gpt2

    Not fully finished yet, haven't gotten around to implementing bpe encoding/decoding and only some ops use BLAS.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • eigenGPT

    Minimal C++ implementation of GPT2

    • From the same twitter thread, a dense implementation in less than 100 lines of plan C!

    https://github.com/davidar/eigenGPT

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts