[P] OSLO: Open Source framework for Large-scale transformer Optimization

• transformers

  175 125,021 10.0 Python

  🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.

  

OSLO is a framework that provides various GPU based optimization features for large-scale modeling. As of 2021, the [Hugging Face Transformers](https://github.com/huggingface/transformers) is being considered de facto standard. However, it does not best fit the purposes of large-scale modeling yet.

• oslo

  2 272 9.8 Python

  Discontinued OSLO: Open Source framework for Large-scale model Optimization (by tunib-ai)

  

This is where OSLO comes in. OSLO is designed to make it easier to train large models with the Transformers. For example, you can fine-tune [GPTJ](https://huggingface.co/EleutherAI/gpt-j-6B) on the [Hugging Face Model Hub](https://huggingface.co/models) without many extra efforts using OSLO. Currently, GPT2, GPTNeo, and GPTJ are supported, but we plan to support more soon. For more information, see https://github.com/tunib-ai/oslo !

• InfluxDB

  www.influxdata.com sponsored

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

Suggest a related project