Workers AI: serverless GPU-powered inference on Cloudflare’s global network

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

InfluxDB – Built for High-Performance Time Series Workloads
InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  1. discourse-ai

    Embedding cost and model choice makes this a very compelling choice. I'm working on leveraging embeddings in https://github.com/discourse/discourse-ai where it powers offering related topics, semantic search, tag and category recommendations among other things.

    A cheap offering like this can make it a lot more reasonable for self-hosters.

  2. InfluxDB

    InfluxDB – Built for High-Performance Time Series Workloads. InfluxDB 3 OSS is now GA. Transform, enrich, and act on time series data directly in the database. Automate critical tasks and eliminate the need to move data externally. Download now.

    InfluxDB logo
  3. whisper-turbo

    Cross-Platform, GPU Accelerated Whisper 🏎️

    Whisper large is only 1.5B params, why not run it client side with something like https://github.com/FL33TW00D/whisper-turbo

    (Disclaimer: I am the author)

  4. get-beam

    Discontinued Run GPU inference and training jobs on serverless infrastructure that scales with you.

    Serverless only works if the cold boot is fast. For context, my company runs a serverless cloud GPU product called https://beam.cloud, which we've optimized for fast cold start. We see Whisper in production cold start in under 10s (across model sizes). A lot of our users are running semi-real time STT, and this seems to be working well for them.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • ChatGPT Voice Assistant (Open Source)

    1 project | news.ycombinator.com | 23 May 2024
  • ChatGPT refuses to create a poem admiring Donald Trump but creates a poem and admires Joe Biden. ChatGPT is built in with political biases.

    1 project | /r/walkaway | 31 Jan 2023
  • MLflow VS VevestaX - a user suggested alternative

    2 projects | 12 May 2022
  • Here's a repository where I try to keep up with the most interesting research papers of 2022. It is a curated list of the latest breakthroughs in AI and Data Science by release date with a clear video explanation, link to a more in-depth article, and code (if applicable).

    2 projects | /r/artificial | 9 May 2022
  • [P] Rubrix: Open-source Python framework for NLP data annotation, exploration, and monitoring

    2 projects | /r/MachineLearning | 13 Sep 2021

Did you know that Shell is
the 11th most popular programming language
based on number of references?