llm.ts
depot.ai
| llm.ts | depot.ai | |
|---|---|---|
| 3 | 3 | |
| 203 | 81 | |
| - | - | |
| 4.8 | 7.7 | |
| about 1 year ago | 13 days ago | |
| TypeScript | TypeScript | |
| MIT License | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
llm.ts
-
OpenLM: A Drop-in OpenAI-compatible library that can call LLMs from most providers (e.g., HuggingFace, Cohere, and more).
r2d4/llm.ts is a TypeScript library that has a similar API that sits on top of multiple language models.
- r2d4/llm.ts: Call any LLM with a single API. Zero dependencies
- r2d4/llm.ts
depot.ai
- GitHub - depot/depot.ai: Embed machine learning models in your Dockerfile
- Depot.ai – Docker registry for public machine learning models
-
Show HN: depot.ai – easily embed ML / AI models in your Dockerfile
To optimize build speed, cache hits, and registry storage, we're building each image reproducibly and indexing the contents with eStargz[0]. The image is stored on Cloudflare R2, and served via a Cloudflare Worker. Everything is open source[1]!
Compared to alternatives like `git lfs clone` or downloading your model at runtime, embedding it with `COPY` produces layers that are cache-stable, with identical hash digests across rebuilds. This means they can be fully cached, even if your base image or source code changes.
And for Docker builders that enable eStargz, copying single files from the image will download only the requested files. eStargz can be enabled in a variety of image builders[2], and we’ve enabled it by default on Depot[3].
Here’s an announcement post with more details: https://depot.dev/blog/depot-ai.
We’d love to hear any feedback you may have!
[0] https://github.com/containerd/stargz-snapshotter/blob/main/docs/estargz.md
[1] https://github.com/depot/depot.ai
[2] https://github.com/containerd/stargz-snapshotter/blob/main/docs/integration.md#image-builders
[3] https://depot.dev
What are some alternatives?
SQLiteGPT - SQL function for SQLite to directly query OpenAI's ChatGPT
modelfusion - The TypeScript library for building AI applications.
openlm - OpenAI-compatible Python client that can call any LLM
stargz-snapshotter - Fast container image distribution plugin with lazy pulling
SolidUI - one sentence generates any graph
obsidian-textgenerator-plugin - Text generator is a handy plugin for Obsidian that helps you generate text content using GPT-3 (OpenAI).
HuggingChatAllInOne - One Repo To Quickly Build One Docker File for HuggingChat Front and BackEnd
cli - 🖥️ Depot CLI, build your Docker images in the cloud
drqa - How to create Question-Answering system combining Langchain and OpenAI
build-push-action - GitHub Action to build and push Docker images with Depot
GPTyped - A simple library to send, receive and verify structured data (JSON) to OpenAI and other LLMs.
deep-chat - Fully customizable AI chatbot component for your website