Top 3 TypeScript Encoder Projects

gpt-tokenizer

1 380 3.3 TypeScript

JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT-2 / GPT-3 / GPT-4. Port of OpenAI's tiktoken with additional features.

Project mention: I wrote a tokenizer for LLaMA that runs inside the browser | /r/LocalLLaMA | 2023-06-13

There are more differences between GPT2 tokenizer and LLaMA tokenizer than only the vocab and merge data. It would take me some time to do implement a GPT2 tokenizer, and there are already good alternatives for those, so it wouldn't make sense to put time into making another one. For example, this library contains a GPT2 tokenizer: https://github.com/niieani/gpt-tokenizer

gifski-command

1 3 10.0 TypeScript

Node.js module for gifski GIF encoder CLI
SurveyJS

surveyjs.io featured

Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.
video-gif-converter

1 2 10.0 TypeScript

Video to GIF and viceversa converter using ffmpeg and gifski

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

TypeScript Encoder related posts

Jxl.js – JPEG XL Decoder in JavaScript Using WebAssembly in Web Worker

4 projects | news.ycombinator.com | 22 Nov 2022
Colors distorted after PNG > AVIF Photo conversion

2 projects | /r/AV1 | 3 May 2022
Using Saliency in progressive JPEG XL images

2 projects | news.ycombinator.com | 10 Sep 2021
What is best AVIF compression settings without losing quality for 8000x6000 and 4000x3000?

3 projects | /r/AV1 | 1 Sep 2021