OpenAI: Streaming is now available in the Assistants API

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • SurveyJS - Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • langroid

    Harness LLMs with Multi-Agent Programming

  • This was indeed true in the beginning, and I don’t know if this has changed. Inserting messages with Assistant role is crucial for many reasons, such as if you want to implement caching, or otherwise edit/compress a previous assistant response for cost or other reason.

    At the time I implemented a work-around in Langroid[1]: since you can only insert a “user” role message, prepend the content with ASSISTANT: whenever you want it to be treated as an assistant role. This actually works as expected and I was able to do caching. I explained it in this forum:

    https://community.openai.com/t/add-custom-roles-to-messages-...

    [1] the Langroid code that adds a message with a given role, using this above “assistant spoofing trick”:

    https://github.com/langroid/langroid/blob/main/langroid/agen...

  • openai-node

    The official Node.js / Typescript library for the OpenAI API

  • Have you seen/tried the `.runTools()` helper?

    Docs: https://github.com/openai/openai-node?tab=readme-ov-file#aut...

    Example: https://github.com/openai/openai-node/blob/bb4bce30ff1bfb06d...

    (if what you're fundamentally trying to do is really just get JSON out, then I can see how json_mode is still easier).

  • SurveyJS

    Open-Source JSON Form Builder to Create Dynamic Forms Right in Your App. With SurveyJS form UI libraries, you can build and style forms in a fully-integrated drag & drop form builder, render them in your JS app, and store form submission data in any backend, inc. PHP, ASP.NET Core, and Node.js.

    SurveyJS logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts