Apple releases CoreNet, a library for training deep neural networks

This page summarizes the projects mentioned and recommended in the original post on news.ycombinator.com

InfluxDB - Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com
featured
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com
featured
  • corenet

    CoreNet: A library for training deep neural networks

  • > Relationship with CVNets

    > CoreNet evolved from CVNets, to encompass a broader range of applications beyond computer vision. Its expansion facilitated the training of foundational models, including LLMs.

    We can expect it to have grown from here: https://apple.github.io/ml-cvnets/index.html

    It looks like a mid-level implementations of training and inference. You can see in their "default_trainer.py"[1] that the engine uses Tensors from torch but implements a it's own training method. It's an interesting (maybe very Apple) choice to build from the ground up instead of partnering with existing frameworks to provide first class support in them.

    The MLX examples seem to be inference only at this point. It does look like this might be a landing ground for more MLX specific implementations: e.g. https://github.com/apple/corenet/blob/5b50eca42bc97f6146b812...

    It will be interesting to see how it tracks over the next year; especially with their recent acquisitions:

    Datakalab https://news.ycombinator.com/item?id=40114350

    DarwinAI https://news.ycombinator.com/item?id=39709835

    1: https://github.com/apple/corenet/blob/main/corenet/engine/de...

  • Megatron-LM

    Ongoing research training transformer models at scale

  • https://github.com/NVIDIA/Megatron-LM

    This is probably a good baseline to start thinking about LLM training at scale.

  • InfluxDB

    Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.

    InfluxDB logo
  • axlearn

    An Extensible Deep Learning Library

  • It's interesting that Apple also has https://github.com/apple/axlearn, which is a library on top of Jax. Seems like half the ML teams at Apple use PyTorch, and the other half uses Jax.

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a more popular project.

Suggest a related project

Related posts

  • Developing a Generic Streamlit UI to Test Amazon Bedrock Agents

    4 projects | dev.to | 5 May 2024
  • How to Build a Logistic Regression Model: A Spam-filter Tutorial

    1 project | dev.to | 5 May 2024
  • Granary: The Social Web Translator

    1 project | news.ycombinator.com | 5 May 2024
  • Bitcoin Sentiment Analysis using Python and X (Formerly Twitter)

    1 project | dev.to | 5 May 2024
  • Zero Shot Text Classification Under the hood

    1 project | dev.to | 5 May 2024