Our great sponsors
-
WorkOS
The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
This approach may be too high-level "magic" to the point of being difficult to work with and iterate upon.
Looking at the prompt templates (https://github.com/bananaml/fructose/tree/main/src/fructose/... ), they use LangChain-esque "just try to make the output to be valid JSON" when APIs such as the GPT-4 turbo which this model uses by defauly now support function calling/structured data natively, and libraries such as outlines (https://github.com/outlines-dev/outlines) which is more complex but can better ensure a dictionary output for local LLMs
This approach may be too high-level "magic" to the point of being difficult to work with and iterate upon.
Looking at the prompt templates (https://github.com/bananaml/fructose/tree/main/src/fructose/... ), they use LangChain-esque "just try to make the output to be valid JSON" when APIs such as the GPT-4 turbo which this model uses by defauly now support function calling/structured data natively, and libraries such as outlines (https://github.com/outlines-dev/outlines) which is more complex but can better ensure a dictionary output for local LLMs
Why do you have Guidance in caps?
https://github.com/guidance-ai/guidance
or ...
https://huggingface.co/docs/text-generation-inference/concep...
or ... ?
A quick glance through these, they don't seem yet to call json_object on OpenAI with the word JSON in the prompt, which works wonders with the 0125 models.
Good stuff. How does this compare to Instructor? I’ve been using this extensively
https://jxnl.github.io/instructor/
https://www.youtube.com/watch?v=HnOix9TFy1A
Links to more projects and papers by Prof. Polikarpova: https://cseweb.ucsd.edu/~npolikarpova/
I think this is one of the main ones she discusses in the talk: https://github.com/nadia-polikarpova/synquid
Have you done any comparison with DSPy ? (https://github.com/stanfordnlp/dspy)
Feels very similiar to DSPy except you dont have optimizations yet. But I like your API and the programming model your are enforcing through this.