replicate-javascript
pytorch-lightning
replicate-javascript | pytorch-lightning | |
---|---|---|
8 | 9 | |
426 | 27,262 | |
4.7% | 1.4% | |
8.9 | 9.9 | |
3 days ago | 1 day ago | |
TypeScript | Python | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
replicate-javascript
-
Ask HN: Who is hiring? (June 2024)
Replicate (YC W20) | San Francisco, CA + Remote | https://replicate.com/
Replicate makes it easy to run AI in the cloud. You can run a big library of open source models with a few lines of code, or deploy your own models at scale.
We're an experienced team from Spotify, Docker, GitHub, Heroku, Apple, and various other places. We're backed by a16z, Sequoia, Andrej Karpathy, Dylan Field, Guillermo Rauch.
We're hiring:
- An infrastructure engineer
- An expert at deploying and optimizing language models
- An engineer who is good at humans to look after our customers
... and more: https://replicate.com/about#join-us
Email us: [email protected]
-
Building a Retrieval-Augmented Generation Chatbot with SvelteKit and Xata Vector Search
import { experimental_buildLlama2Prompt } from 'ai/prompts'; // Now use Replicate LLAMA 70B streaming to perform the autocompletion with context const response = await replicate.predictions.create({ // You must enable streaming. stream: true, // The model must support streaming. See https://replicate.com/docs/streaming model: 'meta/llama-2-70b-chat', // Format the message list into the format expected by Llama 2 // @see https://github.com/vercel/ai/blob/99cf16edf0a09405d15d3867f997c96a8da869c6/packages/core/prompts/huggingface.ts#L53C1-L78C2 input: { prompt: experimental_buildLlama2Prompt([ { // create a system content message to be added as // the llama2prompt generator will supply it as the context with the API role: 'system', content: systemContext }, { // create a system instruction // make sure to wrap code blocks with ``` {% endraw %} so that the svelte markdown picks it up correctly role: 'assistant', content: {% raw %}`When creating repsonses sure to wrap any code blocks that you output as code blocks and not text so that they can be rendered beautifully.`{% endraw %} }, // also, pass the whole conversation! ...messages ]) } }); {% raw %}
-
Wasp x Supabase: Smokin’ Hot Full-Stack Combo 🌶️ 🔥
We used Replicate to run the models and the cost so far is 26 cents for 90 cards — which means it’s less than a third of a cent per card!
-
Tap into 17 LLMs with a Single API – Free with Unlimited Tokens
Basically https://replicate.com/
Because it happens when running your own models on localhost too. I have ollama and all the ones they support, but there are some on HuggingFace I run through llama.cpp inside apps where I won't have ollama installed, Replicate also has Stable Diffusion models, not just chat ones, and OpenAI which is its own thing. So it could potentially all be unified under a provider like that.
Haven't actually tried Replicate because I'm just running locally for free, but probably would try to find a single cloud provider for all deployments, like a Heroku of LLMs.
-
SB-1047 will stifle open-source AI and decrease safety
It's very easy to get started, right in your Terminal, no fees! No credit card at all.
And there are cloud providers like https://replicate.com/ and https://lightning.ai/ that will let you use your LLM via an API key just like you did with OpenAI if you need that.
You don't need OpenAI - nobody does.
-
How to Estimate Depth from a Single Image
In this section, we’ll show you how to generate MDE depth map predictions with both DPT and Marigold. In both cases, you can optionally run the model locally with the respective Hugging Face library, or run remotely with Replicate.
-
Building a self-creating website with Supabase and AI
Built with Supabase, Astro, Unreal Speech, Stable Diffusion, Replicate, Metropolitan Museum of Art
-
From Chaos to Clarity with AI-driven Categorization
Now that we understand the process, let’s take a look at the actual code. The first step is simply importing our dependencies. Note that we will be using the replicate npm package, which you can install with npm i replicate.
pytorch-lightning
-
SB-1047 will stifle open-source AI and decrease safety
It's very easy to get started, right in your Terminal, no fees! No credit card at all.
And there are cloud providers like https://replicate.com/ and https://lightning.ai/ that will let you use your LLM via an API key just like you did with OpenAI if you need that.
You don't need OpenAI - nobody does.
- Lightning AI Studios – A persistent GPU cloud environment
-
Como empezar con inteligencia artificial?
https://see.stanford.edu/Course/CS229 https://lightning.ai/ https://www.youtube.com/watch?v=00s9ireCnCw&t=57s https://towardsdatascience.com/
-
Best practice for saving logits/activation values of model in PyTorch Lightning
I've been wondering on what is the recommended method of saving logits/activations using PyTorch Lightning. I've looked at Callbacks, Loggers and ModelHooks but none of the use-cases seem to be for this kind of activity (even if I were to create my own custom variants of each utility). The ModelCheckpoint Callback in its utility makes me feel like custom Callbacks would be the way to go but I'm not quite sure. This closed GitHub issue does address my issue to some extent.
- New to ML, which is easier to learn - Tensorflow or PyTorch?
- PyTorch Lightning – DL framework to train, deploy, and ship AI fast
-
We just release a complete open-source solution for accelerating Stable Diffusion pretraining and fine-tuning!
Our codebase for the diffusion models builds heavily on OpenAI's ADM codebase , lucidrains, Stable Diffusion, Lightning and Hugging Face. Thanks for open-sourcing!
-
An elegant and strong PyTorch Trainer
For lightweight use, pytorch-lightning is too heavy, and its source code will be very difficult for beginners to read, at least for me.
-
[D] Mixed Precision Training: Difference between BF16 and FP16
For the A100 GPU, theoretical performance is the same for FP16/BF16 and both rely on the same number of bits, meaning memory should be the same. However since it's quite newly added to PyTorch, performance seems to still be dependent on underlying operators used (pytorch lightning debugging in progress here).
What are some alternatives?
lnd - Lightning Network Daemon ⚡️
Eclair - A scala implementation of the Lightning Network.
mmdetection - OpenMMLab Detection Toolbox and Benchmark
composer - Supercharge Your Model Training
umbrel - A beautiful home server OS for self-hosting with an app store. Buy a pre-built Umbrel Home with umbrelOS, or install on a Raspberry Pi 4, Pi 5, any Ubuntu/Debian system, or a VPS.
Keras - Deep Learning for humans
fastai - The fastai deep learning library
RTL - Ride The Lightning - A full function web browser app for LND, C-Lightning and Eclair
mmcv - OpenMMLab Computer Vision Foundation
skorch - A scikit-learn compatible neural network library that wraps PyTorch
c-lightning-REST - REST APIs for Core Lightning written with node.js
metaflow - :rocket: Build and manage real-life ML, AI, and data science projects with ease!