Nvidia reveals new A.I. chip, says costs of running LLMs will drop significantly

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

Our great sponsors
  • InfluxDB - Power Real-Time Data Analytics at Scale
  • WorkOS - The modern identity platform for B2B SaaS
  • SaaSHub - Software Alternatives and Reviews
  • iree

    A retargetable MLIR-based machine learning compiler and runtime toolkit.

  • I want to promote that the Google project https://github.com/openxla/iree exists and IREE acts as a way to turn Tensorflow, Pytorch, and MLIR workflows to compute on cpu, vulkan compute, cuda, rocm, metal and others.

    https://github.com/RechieKho/IREE.gd -- RechieKho and I collaborate on making this work for Godot Engine, but IREE.gd is at a proof of concept stage.

  • iree.gd

    Running Pre-trained Machine Learning Model in Godot.

  • I want to promote that the Google project https://github.com/openxla/iree exists and IREE acts as a way to turn Tensorflow, Pytorch, and MLIR workflows to compute on cpu, vulkan compute, cuda, rocm, metal and others.

    https://github.com/RechieKho/IREE.gd -- RechieKho and I collaborate on making this work for Godot Engine, but IREE.gd is at a proof of concept stage.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • stable-diffusion-webui

    Stable Diffusion web UI

  • >I'm not sure how has Nvidia come to absolutely dominate this market

    They had the foresight to see the coming wave and ensure they have both best hardware and best software stack.

    What puzzles me more is why AMD isn't throwing money at their software side to sort that out. Rocm was launched in 2016. 7 years later running pytorch on their flagship GPU still requires a janky laundry list of crowdsourced instructions:

    https://github.com/AUTOMATIC1111/stable-diffusion-webui/disc...

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts