DBRX: A New Open LLM

• dbrx

  4 2,363 3.7 Python

  Code examples and resources for DBRX, a large language model developed by Databricks

  

Looking at the license restrictions: https://github.com/databricks/dbrx/blob/main/LICENSE

"If, on the DBRX version release date, the monthly active users of the products or services made available by or for Licensee, or Licensee’s affiliates, is greater than 700 million monthly active users in the preceding calendar month, you must request a license from Databricks, which we may grant to you in our sole discretion, and you are not authorized to exercise any of the rights under this Agreement unless or until Databricks otherwise expressly grants you such rights."

I'm glad to see they aren't calling it open source, unlike some LLM projects. Looking at you LLama 2.

• llama

  184 52,603 8.1 Python

  Inference code for Llama models

  

Ironically, the LLaMA license text [1] this is lifted verbatim from is itself copyrighted [2] and doesn't grant you the permission to copy it or make changes like s/meta/dbrx/g lol.

[1] https://github.com/meta-llama/llama/blob/main/LICENSE#L65

• WorkOS

  workos.com sponsored

  The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.

  

• makeMoE

  3 501 9.0 Jupyter Notebook

  From scratch implementation of a sparse mixture of experts language model inspired by Andrej Karpathy's makemore :)

This repo I created and the linked blog will help in understanding this: https://github.com/AviSoori1x/makeMoE

• mixtral-offloading

  3 2,230 8.7 Python

  Run Mixtral-8x7B models in Colab or consumer desktops

Waiting for Mixed Quantization with MQQ and MoE Offloading [1]. With that I was able to run Mistral 8x7B on my 10 GB VRAM rtx3080... This should work for DBRX and should shave off a ton of VRAM requirement.

1. https://github.com/dvmazur/mixtral-offloading?tab=readme-ov-...

Suggest a related project