Top 3 Rust lexer-generator Projects

logos

15 2,620 8.5 Rust

Create ridiculously fast Lexers (by maciejhirsz)

Project mention: Beating the fastest lexer generator in Rust | /r/rust | 2023-07-11

This is mighty impressive! I've been trying to get some motivation for the mythical rewrite of the proc macro in Logos, and this might just do it for me :D. I'll have a proper look later today and see if any of your findings have something that can be generalized. Also really surprised to see aarch64 doing better than x86_64 since the latter is what I've been optimizing for!

plex

1 399 5.2 Rust

a parser and lexer generator as a Rust procedural macro (by goffrie)
WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
lexgen

4 60 5.9 Rust

A fully-featured lexer generator, implemented as a proc macro

Project mention: How are macros dealt with for incremental compilation? | /r/rust | 2023-05-06

Indeed this is the problem I'm having with my proc macro crates lexgen and parsegen. In the case of lexgen, the proc macro is actually quite fast for realistic inputs, but the compiler spends a lot of time checking and generated code with cargo check (which I suspect rust-analyzer also uses). In the case of parsegen the proc macro does some analyses and takes some time. In both cases I have to split my proc macro code (not the proc macros, the code that uses the proc macros) to separate crates so that they won't be recompiler/re-analyzed as I work on the code.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).