Top 8 Python program-synthesis Projects

PythonProgrammingPuzzles

11 948 5.4 Python

A Dataset of Python Challenges for AI Research
evalplus

3 865 9.3 Python

EvalPlus for rigourous evaluation of LLM-synthesized code

Project mention: The AI Reproducibility Crisis in GPT-3.5/GPT-4 Research | news.ycombinator.com | 2023-08-25

*Further Reading*:
- [GPT-4's decline over time (HackerNews)](https://news.ycombinator.com/item?id=36786407)
- [GPT-4 downgrade discussions (OpenAI Forums)](https://community.openai.com/t/gpt-4-has-been-severely-downg...)
- [Behavioral changes in ChatGPT (arXiv)](https://arxiv.org/abs/2307.09009)
- [Zero-Shot Replication Effort (Github)](https://github.com/emrgnt-cmplxty/zero-shot-replication)
- [Inconsistencies in GPT-4 HumanEval (Github)](https://github.com/evalplus/evalplus/issues/15)
- [Early experiments with GPT-4 (arXiv)](https://arxiv.org/abs/2303.12712)
- [GPT-4 Technical Report (arXiv)](https://arxiv.org/abs/2303.08774)

WorkOS

workos.com sponsored

The modern identity platform for B2B SaaS. The APIs are flexible and easy-to-use, supporting authentication, user identity, and complex enterprise features like SSO and SCIM provisioning.
parsel

7 375 0.0 Python

Code for Parsel 🐍 - generate complex programs with language models (by ezelikman)
apps

1 334 0.0 Python

APPS: Automated Programming Progress Standard (NeurIPS 2021) (by hendrycks)
Popper

1 175 9.5 Python

An inductive logic programming system (by logic-and-learning-lab)

Project mention: Prolog for Data Science | news.ycombinator.com | 2023-05-07

I finished my master's thesis in Inductive Logic Programming recently at Oxford. I'd say that the field has continued improving since Aleph, which was written in the late 90s.
Anyone interested could also take a look at Popper (https://github.com/logic-and-learning-lab/Popper) or this overview of the first 30 years of ILP (https://arxiv.org/abs/2008.07912)

monitors4codegen

1 105 7.5 Python

Code and Data artifact for NeurIPS 2023 paper - "Monitor-Guided Decoding of Code LMs with Static Analysis of Repository Context". `multispy` is a lsp client library in Python intended to be used to build applications around language servers.

Project mention: Show HN: Multilspy – A library to easily use language servers to analyze code | news.ycombinator.com | 2023-11-28

deepdistilling

1 65 4.9 Python

Mechanistically interpretable neurosymbolic AI (Nature Comput Sci 2024): losslessly compressing NNs to computer code and discovering new algorithms which generalize out-of-distribution and outperform human-designed algorithms

Project mention: Deep distilling: Automated discovery of algorithms from data | news.ycombinator.com | 2024-02-19

InfluxDB

www.influxdata.com sponsored

Power Real-Time Data Analytics at Scale. Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
GAS

2 52 3.2 Python

Generative Art Synthesizer - a python program that generates python programs that generates generative art

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020).