minbpe-cc

Experiements with llm tokenization in cpp (by justinhj)
Review Suggest topics
Source Code
Suggest alternative
Edit details
InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com
featured

Minbpe-cc Alternatives

Similar projects and alternatives to minbpe-cc

justinhj
minbpe-cc

  1. whisper

    372 minbpe-cc VS whisper

    Robust Speech Recognition via Large-Scale Weak Supervision

  2. Stream

    Stream - Scalable APIs for Chat, Feeds, Moderation, & Video. Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.

    Stream logo

  3. tiktoken

    40 minbpe-cc VS tiktoken

    tiktoken is a fast BPE tokeniser for use with OpenAI's models.

  4. sentencepiece

    23 minbpe-cc VS sentencepiece

    Unsupervised text tokenizer for Neural Network-based text generation.

  5. llama-models

    15 minbpe-cc VS llama-models

    Utilities intended for use with Llama models.

  6. python-aiplatform

    2 minbpe-cc VS python-aiplatform

    A Python SDK for Vertex AI, a fully managed, end-to-end platform for data science and machine learning.

  7. tokenizers

    9 minbpe-cc VS tokenizers

    💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

  8. tiktoken

    3 minbpe-cc VS tiktoken

    JS port and JS/WASM bindings for openai/tiktoken (by dqbd)

  9. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo

  10. mistral-common

    3 minbpe-cc VS mistral-common

    Official inference library for pre-processing of Mistral models

  11. tokie

    1 minbpe-cc VS tokie

    Pure-Go byte pair encoding tokenizer

  12. TokenDagger

    2 minbpe-cc VS TokenDagger

    High-Performance Implementation of OpenAI's TikToken.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better minbpe-cc alternative or higher similarity.
Suggest an alternative to minbpe-cc

minbpe-cc discussion

Log in or Post with

minbpe-cc reviews and mentions

Posts with mentions or reviews of minbpe-cc. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2025-06-30.

Stats

Basic minbpe-cc repo stats
1
1
7.8
about 1 month ago

The primary programming language of minbpe-cc is C++.

Popular Comparisons

  1. minbpe-cc VS python-aiplatform
  2. minbpe-cc VS sentencepiece
  3. minbpe-cc VS whisper
  4. minbpe-cc VS tiktoken
  5. minbpe-cc VS tiktoken
  6. minbpe-cc VS tokie
  7. minbpe-cc VS mistral-common
  8. minbpe-cc VS llama-models
  9. minbpe-cc VS TokenDagger
  10. minbpe-cc VS tokenizers

Sponsored
Stream - Scalable APIs for Chat, Feeds, Moderation, & Video.
Stream helps developers build engaging apps that scale to millions with performant and flexible Chat, Feeds, Moderation, and Video APIs and SDKs powered by a global edge network and enterprise-grade infrastructure.
getstream.io

Did you know that C++ is
the 7th most popular programming language
based on number of references?

Loading...