tpu

Open-source projects categorized as tpu
Edit details
Language: + Python + Jupyter Notebook
Topics: Deep Learning Machine Learning Tensorflow GPU Jax
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

Top 11 tpu Open-Source Projects

  • skypilot

    SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

    • Project mention: Ask HN: Most efficient way to fine-tune an LLM in 2024? | news.ycombinator.com | 2024-04-04

  • adanet

    Fast and flexible AutoML with learning guarantees.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • neural-engine

    Everything we actually know about the Apple Neural Engine (ANE)

    • Project mention: Optimize sgemm on RISC-V platform | news.ycombinator.com | 2024-02-28

    yep. they have a neural engine that is separate from the CPU and GPU that does really fast matmuls https://github.com/hollance/neural-engine. it's basically completely undocumented.

  • tpu-starter

    Everything you want to know about Google Cloud TPU

    • Project mention: A user-built manual on using TPUs for AI and LLMs on Google Cloud | news.ycombinator.com | 2023-08-04

  • JAXFLUIDS

    Differentiable Fluid Dynamics Package

    • Project mention: Show HN: Elodin – A better framework for physics simulation | news.ycombinator.com | 2024-03-06

    You are completely correct; right now it is just mechanics that we have built out. But, there isn't any theoretical reason you couldn't use this framework for other types of simulation. In particular, the Monte Carlo runner is super flexible. Since we are based on JAX you can utilize a ton of the tooling that others have built in the physics space like https://github.com/tumaer/JAXFLUIDS or https://github.com/DifferentiableUniverseInitiative/jax_cosm... . The goal right now though is pretty firmly focused on controls engineers and their needs, but we envision this becoming broadly used.

  • Dual-Edge-TPU-Adapter

    Dual Edge TPU Adapter to use it on a system with single PCIe port on m.2 A/B/E/M slot

    • Project mention: Google Coral TPU | /r/selfhosted | 2023-05-23

  • DECIMER-Image_Transformer

    DECIMER: Deep Learning for Chemical Image Recognition using Efficient-Net V2 + Transformer

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo

  • stylegan2-flax-tpu

    🖼 Training StyleGAN2 on TPUs in JAX

    • Project mention: AI Real-Time Human Full-Body Photo Generator | news.ycombinator.com | 2023-08-23

    I’ll take this opportunity to mention our research scaling StyleGAN 2 to larger datasets (using LAION) on food images, leveraging free TPU compute through the TRC program.

    We trained for 36 days on a v4-8 on 558k images.

    https://nyx-ai.github.io/stylegan2-flax-tpu/

    We were hopeful GANs would beat diffusion models when trained on specific domains. But we’ve now switched to Stable Diffusion and Dreambooth training which has proven more much efficient for this purpose.

    I still have hopes for GANs! I miss their insane inference speed.

  • evopose2d

    EvoPose2D is a two-stage human pose estimation model that was designed using neuroevolution. It achieves state-of-the-art accuracy on COCO.

  • FunMatch-Distillation

    TF2 implementation of knowledge distillation using the "function matching" hypothesis from https://arxiv.org/abs/2106.05237.

  • xpk

    xpk (Accelerated Processing Kit, pronounced x-p-k,) is a software tool to help Cloud developers to orchestrate training jobs on accelerators such as TPUs and GPUs on GKE.

    • Project mention: Gemma: New Open Models | news.ycombinator.com | 2024-02-21

    There is a lot of work to make the actual infrastructure and lower level management of lots and lots of GPUs/TPUs open as well - my team focuses on making the infrastructure bit at least a bit more approachable on GKE and Kubernetes.

    https://github.com/GoogleCloudPlatform/ai-on-gke/tree/main

    and

    https://github.com/google/xpk (a bit more focused on HPC, but includes AI)

    and

    https://github.com/stas00/ml-engineering (not associated with GKE, but describes training with SLURM)

    The actual training is still a bit of a small pool of very experienced people, but it's getting better. And every day serving models gets that much faster - you can often simply draft on Triton and TensorRT-LLM or vLLM and see significant wins month to month.

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).

tpu related posts

Index

What are some of the best open-source tpu projects? This list will help you:

Project Stars
1 skypilot 5,636
2 adanet 3,470
3 neural-engine 1,861
4 tpu-starter 453
5 JAXFLUIDS 248
6 Dual-Edge-TPU-Adapter 235
7 DECIMER-Image_Transformer 162
8 stylegan2-flax-tpu 130
9 evopose2d 82
10 FunMatch-Distillation 79
11 xpk 54

Sponsored
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com