AMD ROCm Software Blogs

• hn-search

  1,627 524 2.9 TypeScript

  Hacker News Search

  

Lists don't make great HN submissions: https://hn.algolia.com/?dateRange=all&page=0&prefix=true&sor.... It would be better to pick the most interesting element in the list and submit that instead.

• unsloth

  15 8,282 9.4 Python

  Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory

  

Thanks! Again, partnerships over customers. If you're experienced and have the technical chops to make a MI300x sing, we want to work with you. Our model is that we are the capex/opex investor for businesses. As much as I love software, Hot Aisle is more of a hardware business. Running super high end large scale compute is an extreme challenge in itself. We are less interested in building the software side of things and want to foster those who can focus on that side.

https://github.com/unslothai/unsloth/issues/160

https://github.com/search?q=repo%3Apredibase%2Florax+rocm&ty...

https://github.com/sgl-project/sglang/issues/157

https://github.com/casper-hansen/AutoAWQ (supports rocm)

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• sglang

  3 2,343 9.4 Python

  SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

  

Thanks! Again, partnerships over customers. If you're experienced and have the technical chops to make a MI300x sing, we want to work with you. Our model is that we are the capex/opex investor for businesses. As much as I love software, Hot Aisle is more of a hardware business. Running super high end large scale compute is an extreme challenge in itself. We are less interested in building the software side of things and want to foster those who can focus on that side.

https://github.com/unslothai/unsloth/issues/160

https://github.com/search?q=repo%3Apredibase%2Florax+rocm&ty...

https://github.com/sgl-project/sglang/issues/157

https://github.com/casper-hansen/AutoAWQ (supports rocm)

• AutoAWQ

  2 1,210 9.5 Python

  AutoAWQ implements the AWQ algorithm for 4-bit quantization with a 2x speedup during inference. Documentation:

Thanks! Again, partnerships over customers. If you're experienced and have the technical chops to make a MI300x sing, we want to work with you. Our model is that we are the capex/opex investor for businesses. As much as I love software, Hot Aisle is more of a hardware business. Running super high end large scale compute is an extreme challenge in itself. We are less interested in building the software side of things and want to foster those who can focus on that side.

https://github.com/unslothai/unsloth/issues/160

https://github.com/search?q=repo%3Apredibase%2Florax+rocm&ty...

https://github.com/sgl-project/sglang/issues/157

https://github.com/casper-hansen/AutoAWQ (supports rocm)

Suggest a related project