[Announcement] HuggingFace BigScience AMA Thursday, March 24th from 5pm CET

• lm-evaluation-harness

  34 5,070 9.9 Python

  A framework for few-shot evaluation of language models.

  

So far, in the architecture & scaling group, we have been benchmarking models mainly with the EleutherAI Language Model Evaluation Harness. In cooperation with the multilingual group, we have also considered XNLI for multilingual evaluation. You can read more about our work in our paper.

• bigscience

  4 938 3.2 Shell

  Central place for the engineering/scaling WG: documentation, SLURM scripts and logs, compute environment and data.

  

Model architecture and a blog post on decisions on architecture, size, shape, and pretraining duration

• InfluxDB

  www.influxdata.com featured

  Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

  

• Pytorch

  340 78,016 10.0 Python

  Tensors and Dynamic neural networks in Python with strong GPU acceleration

  

And if you want to see int4 - please vote for it here: https://github.com/pytorch/pytorch/issues/74627 - unless the community votes I don't see it'll happen any time soon.

• t-zero

  2 448 0.0 Python

  Reproduce results and replicate training fo T0 (Multitask Prompted Training Enables Zero-Shot Task Generalization)

  

You have T0 that came from BigScience as well: https://github.com/bigscience-workshop/t-zero / https://huggingface.co/bigscience/T0

Suggest a related project