LOGICGUIDE
Sophia
| LOGICGUIDE | Sophia | |
|---|---|---|
| 2 | 3 | |
| 15 | 378 | |
| - | 0.3% | |
| 6.1 | 5.2 | |
| over 1 year ago | 8 months ago | |
| Python | Python | |
| Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
LOGICGUIDE
- Large Language Models for Compiler Optimization
-
[D] Potential scammer on github stealing work of other ML researchers?
I was looking for implementation of this paper https://arxiv.org/pdf/2306.04031.pdf so I searched for logicguide github and found this repo https://github.com/kyegomez/LOGICGUIDE
Sophia
- [D] Potential scammer on github stealing work of other ML researchers?
-
[R] Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training
Github repo
-
The Sophia optimizer, a faster alternative to AdamW
Code: https://github.com/kyegomez/Sophia
Looking forward to trying it out this week
What are some alternatives?
ml-compiler-opt - Infrastructure for Machine Learning Guided Optimization (MLGO) in LLVM.
Otter - 🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.
Dalle3 - An API for DALLE-3
Adan - Adan: Adaptive Nesterov Momentum Algorithm for Faster Optimizing Deep Models
ToolEmu - [ICLR'24 Spotlight] A language model (LM)-based emulation framework for identifying the risks of LM agents with tool use
Adan-pytorch - Implementation of the Adan (ADAptive Nesterov momentum algorithm) Optimizer in Pytorch
certified-reasoning - Certified Reasoning with Language Models
Sophia - The official implementation of “Sophia: A Scalable Stochastic Second-order Optimizer for Language Model Pre-training”
Perceiver - Implementation of Perceiver, General Perception with Iterative Attention in TensorFlow
tree-of-thoughts - Plug in and Play Implementation of Tree of Thoughts: Deliberate Problem Solving with Large Language Models that Elevates Model Reasoning by atleast 70%
zeta - Build high-performance AI models with modular building blocks
deep-daze - Simple command line tool for text to image generation using OpenAI's CLIP and Siren (Implicit neural representation network). Technique was originally created by https://twitter.com/advadnoun