relm

ReLM is a Regular Expression engine for Language Models (by mkuchnik)

Relm Alternatives

Similar projects and alternatives to relm

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better relm alternative or higher similarity.

relm reviews and mentions

Posts with mentions or reviews of relm. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2023-08-14.
  • Show HN: LLMs can generate valid JSON 100% of the time
    25 projects | news.ycombinator.com | 14 Aug 2023
    I'm not sure how this is different than:

    https://github.com/1rgs/jsonformer

    or

    https://github.com/newhouseb/clownfish

    or

    https://github.com/mkuchnik/relm

    or

    https://github.com/ggerganov/llama.cpp/pull/1773

    or

    https://github.com/Shopify/torch-grammar

    Overall there are a ton of these logit based guidance systems, the reason they don't get tons of traction is the SOTA models are behind REST APIs that don't enable this fine-grained approach.

    Those models perform so much better that people generally settle for just re-requesting until they get the correct format (and with GPT-4 that ends up being a fairly rare occurrence in my experience)

  • CMU Researchers Introduce ReLM: An AI System For Validating And Querying LLMs Using Standard Regular Expressions
    1 project | /r/machinelearningnews | 8 Jun 2023
    Github: https://github.com/mkuchnik/relm
  • Jsonformer: A bulletproof way to generate structured output from LLMs
    8 projects | news.ycombinator.com | 2 May 2023
    I have stumbled upon your repository a week ago and I have to say, great work and great ideas!

    Another thing I thought about is integrating formatting for fields using a similar system. ISO-8601 dates comes immediately to mind but also number and currency formatting are other examples.

    Probabilistic enums is another thing that I can think of that might be useful for fallback values, I am pretty sure there's a lot of work that can be done in this area, also for other parser kinds

    related and highly recommended resource is https://github.com/mkuchnik/relm and https://arxiv.org/abs/2211.15458. It is a similar system used to validate LLMs using regexes, however built for completely different use cases. I imagine integrating regex checks to the output fields can also have a lot of use cases.

  • A note from our sponsor - SaaSHub
    www.saashub.com | 7 May 2024
    SaaSHub helps you find the best software and product alternatives Learn more →

Stats

Basic relm repo stats
3
86
5.1
11 months ago

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com