Large Language Models for Compiler Optimization

1. ml-compiler-opt

   1 7 647 8.7 Python

   Infrastructure for Machine Learning Guided Optimization (MLGO) in LLVM.

   

   I did a bit of work on this last summer on (much) smaller models [1] and it was briefly discussed towards the end of last year's MLGO panel [2]. For heuristic replacements specifically, you might be able to glean some things (or just use interpretable models like decision trees), but something like a neural network works fundamentally differently than the existing heuristics, so you probably wouldn't see most of the performance gains. For just tuning heuristics, the usual practice is to make most of the parameters configurable and then use something like bayesian optimization to try and find an optimal set, and this is sometimes done as a baseline in pieces of ML-in-compiler research.

   1. https://github.com/google/ml-compiler-opt/pull/109

2. SaaSHub

   www.saashub.com featured

   SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

   

3. certified-reasoning

   2 1 27 7.9 Python

   Certified Reasoning with Language Models

   https://github.com/gpoesia/certified-reasoning

   It's based on Peano, a theorem proving environment

4. LOGICGUIDE

   3 2 15 6.1 Python

   Plug in and Play implementation of "Certified Reasoning with Language Models" that elevates model reasoning by 40%

Suggest a related project