go-jsonnet VS participle

> jsonnet seemed like a great idea to me, but I've experienced extremely low performance.

Although each implementation of jsonnet has some quirks, take a look at (scala-based) sjsonnet^1 or go-jsonnet^2 for improved performance. We use go-jsonnet because of some issues we had with the scala version - but it does seem to be the fastest by a large margin.

There's also a Rust version^3 that claims to be the fastest yet^4, but I haven't experimented with it at all.

[1]: https://github.com/databricks/sjsonnet

[2]: https://github.com/google/go-jsonnet/

[3]: https://github.com/CertainLach/jrsonnet

[4]: https://gist.github.com/CertainLach/5770d7ad4836066f8e0bd91e...

While I never wrote one, there are some good examples out there beyond the Go compiler itself. Have a look at the Benthos bloblang one (which is quite simple): https://github.com/Jeffail/benthos/tree/master/internal/bloblang and the go-jsonnet VM one (which is more complex): https://github.com/google/go-jsonnet

I know of tools like Kaitai that do essentially what I want, just curious about my options. I guess something like https://github.com/alecthomas/participle could work to parse the format, then I'd have to generate code based on the parsed data or something

This one was recommended in an older thread and looks like it's still actively developed: https://github.com/alecthomas/participle

I like participle: https://github.com/alecthomas/participle. It's pretty easy to get something working if it fits your use case.

Like the other commenters said, it's probably best to just split the string and go through it manually. If you need a real parser, check out: https://github.com/alecthomas/participle

I used https://github.com/alecthomas/participle to implement a custom DSL for some projects. I think there's also an SQL example in the repository. After the parsing is solved it's 'only' about doing something useful with the query but at least you've full control of all aspects, which features you'd like to support and so on.

I made a domain specific language using https://github.com/alecthomas/participle what I found interesting is the grammar defined in structure annotations. After the parser runs, you get a fully instantiated structure based upon the input. I then invoke structure methods to do the work described in the DSL.

Maybe instead of regex you could look into other options.

Shameless plug, but have you compared your Rust parser to https://github.com/alecthomas/participle?