Python finetuning

Open-source Python projects categorized as finetuning

Top 8 Python finetuning Projects

  • learn2learn

    A PyTorch Library for Meta-learning Research

    Project mention: is the reproducibility of omniglot completely broken in l2l? | /r/pytorch | 2022-10-13
  • finetuner

    :dart: Task-oriented embedding tuning for BERT, CLIP, etc.

    Project mention: How do you think search will change with technology like ChatGPT, Bing’s new AI search engine and the upcoming Google Bard? | /r/singularity | 2023-02-21

    And all of that has something to do with finetuners. It basically fine-tunes AI models for specific use cases. With it can create a custom search experience that is tailored to their specific needs. I also wonder how this is going to be integrated into SEO tools soon since those tools are catered to traditional search engines.

  • Sonar

    Write Clean Python Code. Always.. Sonar helps you commit clean code every time. With over 225 unique rules to find Python bugs, code smells & vulnerabilities, Sonar finds the issues while you focus on the work.

  • finetune-gpt2xl

    Guide: Finetune GPT2-XL (1.5 Billion Parameters) and finetune GPT-NEO (2.7 B) on a single GPU with Huggingface Transformers using DeepSpeed

    Project mention: Fine-tuning? | /r/KoboldAI | 2023-02-13

    git clone the finetuning repo https://github.com/Xirider/finetune-gpt2xl go into the finetuning repo, install the rest of the requirements, pip install -r requirements.txt

  • LLM-Finetuning-Hub

    Repository that contains LLM fine-tuning and deployment scripts along with our research findings.

    Project mention: FLaNK Stack Weekly for 12 September 2023 | dev.to | 2023-09-12
  • DB-GPT-Hub

    A repository that contains models, datasets, and fine-tuning techniques for DB-GPT, with the purpose of enhancing model performance, especially in Text-to-SQL.

    Project mention: Show HN: Improve Text-to-SQL Accuracy with LLM | news.ycombinator.com | 2023-07-10
  • llm-toys

    Small(7B and below) finetuned LLMs for a diverse set of useful tasks.

    Project mention: How to fine tune llama2? | /r/LocalLLaMA | 2023-07-27

    You can use the train script here https://github.com/kuutsav/llm-toys/blob/main/llm_toys/train.py. The readme contains a sample training command.

  • Zicklein

    Finetuning instruct-LLaMA on german datasets.

    Project mention: Zicklein - a German 🇩🇪 finetuned LlaMA-7b base model (OS) | /r/LocalLLaMA | 2023-05-22
  • Mergify

    Updating dependencies is time-consuming.. Solutions like Dependabot or Renovate update but don't merge dependencies. You need to do it manually while it could be fully automated! Add a Merge Queue to your workflow and stop caring about PR management & merging. Try Mergify for free.

  • nanoChatGPT

    nanogpt turned into a chat model (by VatsaDev)

    Project mention: A full tutorial on turning GPT-2 into a conversational AI | news.ycombinator.com | 2023-08-31

    Hi, Vatsa here, this is tutorial on turning GPT-2 into a conversational bot, it was a fun project, and I hope you like it it!

    github -> https://github.com/VatsaDev/nanoChatGPT

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-09-12.

Python finetuning related posts

Index

What are some of the best open-source finetuning projects in Python? This list will help you:

Project Stars
1 learn2learn 2,358
2 finetuner 1,192
3 finetune-gpt2xl 401
4 LLM-Finetuning-Hub 352
5 DB-GPT-Hub 325
6 llm-toys 90
7 Zicklein 30
8 nanoChatGPT 16
Collect and Analyze Billions of Data Points in Real Time
Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
www.influxdata.com