Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →
TypeScript Decoder Projects
-
gpt-tokenizer
JavaScript BPE Tokenizer Encoder Decoder for OpenAI's GPT-2 / GPT-3 / GPT-4. Port of OpenAI's tiktoken with additional features.
Project mention: I wrote a tokenizer for LLaMA that runs inside the browser | /r/LocalLLaMA | 2023-06-13There are more differences between GPT2 tokenizer and LLaMA tokenizer than only the vocab and merge data. It would take me some time to do implement a GPT2 tokenizer, and there are already good alternatives for those, so it wouldn't make sense to put time into making another one. For example, this library contains a GPT2 tokenizer: https://github.com/niieani/gpt-tokenizer
-
-
SurveyJS
Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.
TypeScript Decoder related posts
- Colors distorted after PNG > AVIF Photo conversion
- Elm-inspired TypeScript decoding library now supports recursive decoders!
- What is best AVIF compression settings without losing quality for 8000x6000 and 4000x3000?
- λ "Functions all the way down" data validation for JavaScript and TypeScript
- Tiny Elm-like decoders for TypeScript have just been released!
-
A note from our sponsor - InfluxDB
www.influxdata.com | 28 Mar 2024
Index
Project | Stars | |
---|---|---|
1 | gpt-tokenizer | 361 |
2 | schemawax | 55 |