LLaMA Optimized for AMD GPUs

• SHARK

  84 1,387 9.4 Python

  SHARK - High Performance Machine Learning Distribution

  

SHARK is a high performance machine learning distribution that is built on LLVM, MLIR, OpenXLA’s IREE and nod.ai’s tuning1. It is seamlessly integrated with PyTorch via Torch-mlir2.

• torch-mlir

  1 3 9.1 C++

  The Torch-MLIR project aims to provide first class support from the PyTorch ecosystem to the MLIR ecosystem. (by nod-ai)

  

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• SRT

  6 106 0.0 C++

  Nod.ai 🦈 version of 👻 . You probably want to start at https://github.com/nod-ai/shark for the product and the upstream IREE repository for mainline development. This repository houses branches and configuration that aren't ready for commit upstream. (by nod-ai)

  

SHARK-Runtime Implementing Complex Floats

• GPTQ-for-LLaMa

  75 2,924 8.6 Python

  4 bits quantization of LLaMA using GPTQ

Suggest a related project