Run and create custom ChatGPT-like bots with OpenChat

• OpenChat

  13 5,052 9.5 JavaScript

  LLMs custom-chatbots console ⚡

  

Technical question: What code in the websiteHandler.ts is responsible for spidering the website in question?

https://github.com/openchatai/OpenChat/blob/main/llm-server/...

• NeMo-Guardrails

  13 3,338 9.9 Python

  NeMo Guardrails is an open-source toolkit for easily adding programmable guardrails to LLM-based conversational systems.

  

Yes, this is feasible.

Look into https://github.com/NVIDIA/NeMo-Guardrails and specifically to your question there are "topical rails" to ensure the conversation stays on a set of topics you greenlighted.

Also takes care of jailbreaks and allows custom conversation flow templates.

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• awesome-ml

  27 1,402 8.8

  Curated list of useful LLM / Analytics / Datascience resources

Disclaimer: I am curating LLM-tools on github [1]

A few thoughts:

* allow for custom endpoint URLs, this way people can use open source LLMs with a fake openAI API backend like basaran[2] or llama-api-server[3]

* look into better embedding methods for info-retrieval like InstructorEmbeddings or Document Summary Index

* Don't use a single embedding per content item, use multiple to increase retrieval quality

1 https://github.com/underlines/awesome-marketing-datascience/...

2 https://github.com/hyperonym/basaran

3 https://github.com/iaalm/llama-api-server

• basaran

  22 1,281 10.0 Python

  Discontinued Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.

  

Disclaimer: I am curating LLM-tools on github [1]

A few thoughts:

* allow for custom endpoint URLs, this way people can use open source LLMs with a fake openAI API backend like basaran[2] or llama-api-server[3]

* look into better embedding methods for info-retrieval like InstructorEmbeddings or Document Summary Index

* Don't use a single embedding per content item, use multiple to increase retrieval quality

1 https://github.com/underlines/awesome-marketing-datascience/...

2 https://github.com/hyperonym/basaran

3 https://github.com/iaalm/llama-api-server

• llama-api-server

  1 177 6.5 Python

  A OpenAI API compatible REST server for llama.

Disclaimer: I am curating LLM-tools on github [1]

A few thoughts:

* allow for custom endpoint URLs, this way people can use open source LLMs with a fake openAI API backend like basaran[2] or llama-api-server[3]

* look into better embedding methods for info-retrieval like InstructorEmbeddings or Document Summary Index

* Don't use a single embedding per content item, use multiple to increase retrieval quality

1 https://github.com/underlines/awesome-marketing-datascience/...

2 https://github.com/hyperonym/basaran

3 https://github.com/iaalm/llama-api-server

• convostack

  5 191 8.7 TypeScript

  Plug and play embeddable AI chatbot widget and backend deployment framework

  

https://github.com/ConvoStack/convostack

• magma-chat

  4 202 8.4 Ruby

  Ruby on Rails 7-based ChatGPT Bot Platform

  

This feels similar to MagmaChat [1] which I open sourced about a month ago. Except mine is in Ruby on Rails.

[1] https://magmachat.ai

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• simpleAI

  11 319 7.3 Python

  An easy way to host your own AI API and expose alternative models, while being compatible with "open" AI clients.

Using this as an opportunity to mention my own related project, perhaps it can end up on your nice list one day. :)

https://github.com/lhenault/SimpleAI

• lmql

  30 3,320 9.5 Python

  A language for constraint-guided and efficient LLM programming.

  

- https://lmql.ai/

• guidance

  89 12,248 9.5 Jupyter Notebook

  Discontinued A guidance language for controlling large language models. [Moved to: https://github.com/guidance-ai/guidance] (by microsoft)

  

When you're building applications on top of LLMs, there are a number of central problems that you're trying to solve and this is one of them. Solutions are numerous and widely variable, everything from basic regex parsing to fine-tuning validator models to new programming/modeling languages. Here's some examples:

  - https://github.com/microsoft/guidance

• rellm

  7 486 5.0 Python

  Exact structure out of any language model completion.

- https://github.com/r2d4/rellm

• gpt-jargon

  2 219 7.7 Python

  Jargon is a natural language programming language specified and executed by LLMs like GPT-4.

Suggest a related project