OpenLLM: An open platform for operating large language models (LLMs) in production.

• OpenLLM

  25 8,857 9.9 Python

  Run any open-source LLMs, such as Llama 2, Mistral, as OpenAI compatible API endpoint in the cloud.

  

• mlc-llm

  89 17,053 9.9 Python

  Enable everyone to develop, optimize and deploy AI models natively on everyone's devices.

  

Actually it is being researched upon ! https://github.com/mlc-ai/mlc-llm/tree/main But far from reality for sure. Soon like crypto we will have malware running LLM on phone serving websites running LLM :p

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project