Transformer fine-tuning on decentralized data

This page summarizes the projects mentioned and recommended in the original post on /r/learnmachinelearning
#Flower #federated-learning #federated-learning-framework #pytorch-federated-learning #tensorflow-federated-learning

Our great sponsors
  • InfluxDB - Collect and Analyze Billions of Data Points in Real Time
  • Mergify - Updating dependencies is time-consuming.
  • Sonar - Write Clean Python Code. Always.
Our great sponsors

  • flower

    Flower: A Friendly Federated Learning Framework (by adap)

    Large language models like GPT-3 have gained immense popularity recently, and, using Flower, it's easy to transform an existing Hugging Face workflow to train models on decentralized data. This example blog post will show how to fine-tune a pre-trained distilBERT model on the IMDB dataset for sequence classification (determining if a movie review is positive or not). You can also check out the associated Colab notebook and the code example from the Flower repo.

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts