-
-
InfluxDB
Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
That’s where Ollama comes in! Ollama is a free and open-source application that allows you to run various large language models, including Llama 3, on your own computer, even with limited resources. Ollama takes advantage of the performance gains of llama.cpp, an open source library designed to allow you to run LLMs locally with relatively low hardware requirements. It also includes a sort of package manager, allowing you to download and use LLMs quickly and effectively with just a single command.
Open WebUI is an extensible, self-hosted UI that runs entirely inside of Docker. It can be used either with Ollama or other OpenAI compatible LLMs, like LiteLLM or my own OpenAI API for Cloudflare Workers.
Related posts
-
HMT: Hierarchical Memory Transformer for Long Context Language Processing
-
The Easiest Way to Run Llama 3 Locally
-
Using Llamafiles for Embeddings in Local RAG Applications
-
Video Tutorial - How To Run Llama 3 locally with Ollama and OpenWebUI!
-
Building a Retrieval-Augmented Generation Chatbot with SvelteKit and Xata Vector Search