tokenizers-ruby
Fast state-of-the-art tokenizers for Ruby (by ankane)
halton-rb
A Ruby library, written in Rust, for generating Halton sequences (by matsadler)
tokenizers-ruby | halton-rb | |
---|---|---|
2 | 2 | |
117 | 7 | |
- | - | |
7.5 | 2.3 | |
7 days ago | 10 months ago | |
Rust | Ruby | |
Apache License 2.0 | MIT License |
The number of mentions indicates the total number of mentions that we've tracked plus the number of user suggested alternatives.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
tokenizers-ruby
Posts with mentions or reviews of tokenizers-ruby.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-02-11.
-
Magnus 0.5 released (Library for writing Ruby gems in Rust)
tokenizers
-
Text generation with GPT-2 in Ruby
The tokenizers gem is written in Rust, so installation requires Rust. If Rust isn't available, blingfire can be used instead.
halton-rb
Posts with mentions or reviews of halton-rb.
We have used some of these posts to build our list of alternatives
and similar projects. The last one was on 2023-02-11.
-
Magnus 0.5 released (Library for writing Ruby gems in Rust)
I do have a Users section in the readme, but it felt rude adding other peoples gems without asking, so currently it only lists my halton gem and a request for submissions.
-
Magnus: Ruby bindings for Rust
This is something I've been working on for a while. It's a friendlier way to write native extension gems for Ruby, using Rust instead of C. Here's an example gem: https://github.com/matsadler/halton-rb
What are some alternatives?
When comparing tokenizers-ruby and halton-rb you can also consider the following projects:
magnus - Ruby bindings for Rust. Write Ruby extension gems in Rust, or call Ruby from Rust.
CommonMarker - Ruby wrapper for the comrak (CommonMark parser) Rust crate
yrb - Ruby bindings for yrs.
rucaptcha - Captcha Gem for Rails, which generates captcha image by Rust.
polars-ruby - Blazingly fast DataFrames for Ruby
selma - Selma selects and matches HTML nodes using CSS rules. Backed by Rust's lol_html parser.
wasmtime-rb - Ruby WebAssembly runtime powered by Wasmtime
blingfire-ruby - High speed text tokenization for Ruby
ruby-rust-extension-benchmark - Benchmark Ruby extension using Rust (Helix, Ruru, Rutie, FFI) and C
tokenizers-ruby vs magnus
halton-rb vs CommonMarker
tokenizers-ruby vs yrb
halton-rb vs yrb
tokenizers-ruby vs rucaptcha
halton-rb vs polars-ruby
tokenizers-ruby vs selma
halton-rb vs magnus
tokenizers-ruby vs wasmtime-rb
halton-rb vs rucaptcha
tokenizers-ruby vs blingfire-ruby
halton-rb vs ruby-rust-extension-benchmark