Ask HN: Most efficient way to fine-tune an LLM in 2024?

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com
Machine Learning Cloud Computing AI Data Science finetuning

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • unsloth

    Finetune Llama 3, Mistral & Gemma LLMs 2-5x faster with 80% less memory

    • Gemma 7b is 2.4x faster than HF + FA2.

    Check out https://github.com/unslothai/unsloth for full benchmarks!

  • axolotl

    Go ahead and axolotl questions

    • The approach I see used is axolotl with QLoRA using cloud GPUs which can be quite cheap.

    https://github.com/OpenAccess-AI-Collective/axolotl

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo

  • dspy

    DSPy: The framework for programming—not prompting—foundation models

  • skypilot

    SkyPilot: Run LLMs, AI, and Batch jobs on any cloud. Get maximum savings, highest GPU availability, and managed execution—all with a simple interface.

  • llm-finetuning

    Guide for fine-tuning Llama/Mistral/CodeLlama models and more

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

    SaaSHub logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • 80% faster, 50% less memory, 0% loss of accuracy Llama finetuning

    6 projects | news.ycombinator.com | 1 Dec 2023

  • 80% faster, 50% less memory, 0% accuracy loss Llama finetuning

    3 projects | news.ycombinator.com | 1 Dec 2023

  • Frouros: A Python library for drift detection in ML systems

    1 project | news.ycombinator.com | 8 Jul 2023

  • [D] Where can I find a list of the foundational academic papers in RL/ML/DL and what are your go-to places to find new academic papers in RL/ML/DL?

    1 project | /r/MachineLearning | 7 Jul 2023

  • Frouros: A Python library for drift detection in ML systems

    1 project | news.ycombinator.com | 12 Jun 2023