random-sample VS replicate-javascript

We'll loop the list of 80 IDs, picking a random piece of art from the original ID list. I'm using stdlib's random-sample which uses Fisher-Yates as its algorithm to randomize entries as I didn't want to bloat my own code too much with these kind of helpers. Fetching the artwork data I unfortunately noticed that some of the artwork do not have images available. This meant that we'll need to loop the list until we have 80 pieces with images. For the main piece of the story we keep things simple and just pick the first one in the list. We store some metadata along the way, too, which we can/will use later.

We used Replicate to run the models and the cost so far is 26 cents for 90 cards — which means it’s less than a third of a cent per card!

Basically https://replicate.com/

Because it happens when running your own models on localhost too. I have ollama and all the ones they support, but there are some on HuggingFace I run through llama.cpp inside apps where I won't have ollama installed, Replicate also has Stable Diffusion models, not just chat ones, and OpenAI which is its own thing. So it could potentially all be unified under a provider like that.

Haven't actually tried Replicate because I'm just running locally for free, but probably would try to find a single cloud provider for all deployments, like a Heroku of LLMs.

It's very easy to get started, right in your Terminal, no fees! No credit card at all.

And there are cloud providers like https://replicate.com/ and https://lightning.ai/ that will let you use your LLM via an API key just like you did with OpenAI if you need that.

You don't need OpenAI - nobody does.

In this section, we’ll show you how to generate MDE depth map predictions with both DPT and Marigold. In both cases, you can optionally run the model locally with the respective Hugging Face library, or run remotely with Replicate.

Built with Supabase, Astro, Unreal Speech, Stable Diffusion, Replicate, Metropolitan Museum of Art

Now that we understand the process, let’s take a look at the actual code. The first step is simply importing our dependencies. Note that we will be using the replicate npm package, which you can install with npm i replicate.