Alternative to LangChain for open LLMs?

This page summarizes the projects mentioned and recommended in the original post on /r/LocalLLaMA

Our great sponsors
  • WorkOS - The modern identity platform for B2B SaaS
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • SaaSHub - Software Alternatives and Reviews
  • haystack

    :mag: LLM orchestration framework to build customizable, production-ready LLM applications. Connect components (models, vector DBs, file converters) to pipelines or agents that can interact with your data. With advanced retrieval methods, it's best suited for building RAG, question answering, semantic search or conversational agent chatbots.

  • guidance

    Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

  • I feel like local models don’t work too well with Langchain - in general I have a better time with guidance (https://github.com/microsoft/guidance) though it does add some complexity since you have to implement the flow and tools by yourself.

  • WorkOS

    The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

    WorkOS logo
  • BrainChulo

    Harnessing the Memory Power of the Camelids

  • On BrainChulo, we’re going 100% guidance mode, see for instance an implementation of Chain of Thoughts on top of a thin guidance wrapper: https://github.com/ChuloAI/BrainChulo/blob/main/app/guidance_tooling/guidance_agent/agent.py

  • andromeda-chain

    Serving hugging face guidance behind a server

  • learn-langchain

  • visio-gptq

  • gptq_for_langchain

    A guide about how to use GPTQ models with langchain

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts