[P] Scalable PaLM implementation of PyTorch

This page summarizes the projects mentioned and recommended in the original post on /r/u_HPCAI-Tech
Deep Learning distributed-training HPC large-scale data-parallelism

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured

  • ColossalAI

    Making large AI models cheaper, faster and more accessible

    • Hi, guys. We use PyTorch and Colossal-AI to implement Google's Pathways Language Model (PaLM). We reproduced the model architect and applied multiple optimization strategies, e.g. data parallelism, tensor parallelism & ZeRO, to scale the training to mulple-GPUs with the help of Colosssal-AI.

  • PaLM-colossalai

    Discontinued Scalable PaLM implementation of PyTorch

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • HPC-AI Tech is Joining NYU’s Endless Frontier Labs Program, Which Has an Under 7% Global Acceptance Rate

    1 project | /r/artificial | 6 Oct 2022

  • Using State-Of-The-Art Artificial Intelligence (AI) Models for Free: Try OPT-175B on Your Cellphone and Laptop

    1 project | /r/ArtificialInteligence | 8 Sep 2022

  • Accelerating Structure Prediction of Protein Monomers and Multimer by 11 Times! An Open Source Solution from Colossal-AI and BioMap

    1 project | /r/artificial | 25 Aug 2022

  • Colossal-AI, A Unified Deep Learning System for Big Models, Seamlessly Accelerates Large Models at Low Costs with Hugging Face​

    1 project | /r/artificial | 13 Jul 2022

  • HPC-AI Tech Joins NVIDIA Inception ​

    1 project | /r/ArtificialInteligence | 29 Jun 2022