faster-cpython
cinder
Our great sponsors
| faster-cpython | cinder | |
|---|---|---|
| 20 | 43 | |
| 937 | 3,375 | |
| - | 0.8% | |
| 0.0 | 9.4 | |
| over 1 year ago | 5 days ago | |
| Python | ||
| - | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
faster-cpython
-
Faster CPython at PyCon, part two
It is unclear to me whether Python 3.12 will receive significant improvements. Based on the information from https://github.com/faster-cpython/benchmarking-public, it appears that there may be a 2% performance enhancement. Is this the anticipated result, or are there additional developments awaiting merger?
Initially, the "Shannon Plan" (https://github.com/markshannon/faster-cpython/blob/master/pl...) aimed for a 50% improvement with each release. Has this goal been deemed unattainable, or are there adjustments being made to the plan?
-
Python-based compiler achieves orders-of-magnitude speedups
Yes, that's the JIT part of the plan. Sections of code will be compiled, "at runtime". Those sections of compiled code will be tied together with interpreted code. It will be somewhere between rare to impossible to have a fully compiled program, without interpreter glue.
- Faster-Cpython Plan.md
-
A Team at Microsoft is Helping Make Python Faster
see: https://github.com/markshannon/faster-cpython/blob/master/plan.md
- Implementation plan for speeding up CPython
-
Does Python plan to add JIT or get rid of the GIL?
Yes, the Shannon plan, which is actively being worked on by a team headed by Guido, includes JIT work in stages 3 and 4
-
Python 3.11 is 25% faster than 3.10 on average
The goal with faster cpython is for small compounding improvements with each point release[0]. So in the end it should be much more than a tiny improvement.
[0] https://github.com/markshannon/faster-cpython/blob/master/pl...
-
Python 3.11 Performance Benchmarks Are Looking Fantastic
The Shannon Plan. Announced by Guido at the 2021 Python Language summit, funded by Microsoft.
Well, good news then, it's in the planning!
- Why hasn't Python compiled/JIT/AHT projects gained mainstream traction?
cinder
-
Meta Used Monolithic Architecture to Ship Threads in Only Five Months
Meta is actually contributing directly to upstream cpython. If you really wanted to, the internal fork is also open source: https://github.com/facebookincubator/cinder
- Meta pledges Three-Year sponsorship for Python if GIL removal is accepted
- Back end of Meta Threads is built with Python 3.10 with some interesting tweaks
-
Lessons from Mojo for PHP 10+ ?
Just one example: last year Meta open-sourced Cinder, which powers Instagram and provides sizeable speedups compared to CPython.
- Python true static typing
-
Best book on writing an optimizing compiler (inlining, types, abstract interpretation)?
I used to work on the Cinder JIT and can help document any passes you find interesting or confusing.
-
Python-based compiler achieves orders-of-magnitude speedups
You might enjoy Cinder then. It's based on CPython so it is nearly 100% compatible.
https://github.com/facebookincubator/cinder/
Disclaimer: I used to work on it.
-
beartype: It has documentation now. It only took two years, my last hair follicle, precious sanity points (SPs), and working with Sphinx. Don't be like @leycec. Go hard on documentation early.
I think Cinder's Static Python, which also performs runtime type checking, is more ambitious. Though it's not production ready yet.
-
If there’s gonna be a Python 4.0 one day, what’s a breaking change you’d like to see? Let’s explore the ideas you have that can make Python even better!
Here's a fork that implements that https://github.com/facebookincubator/cinder - it might be nice to one day get that up streamed but obviously it'll be controversial and it certainly needs more time to bake. Hopefully at some point we can make it a pip installable extension though.
-
Is it time for Python to have a statically-typed, compiled, fast superset?
The other thing that was interesting to me, was the potential of type annotations to help make for a faster, safer experience on the compiler end of things. One example is seen in Meta’s Cinder project, on the docs it explains how typing can be used to reduce the number of steps for the compiler ([cinder/static_python.rst at cinder/3.8 · facebookincubator/cinder · GitHub](https://github.com/facebookincubator/cinder/blob/cinder/3.8/CinderDoc/static_python.rst)), making it more effective.
What are some alternatives?
pyenv-virtualenv - a pyenv plugin to manage virtualenv (a.k.a. python-virtualenv)
Pyjion - Pyjion - A JIT for Python based upon CoreCLR
ideas
Pyjion
jax-md - Differentiable, Hardware Accelerated, Molecular Dynamics [Moved to: https://github.com/jax-md/jax-md]
graalpython - A Python 3 implementation built on GraalVM
Pyston - A faster and highly-compatible implementation of the Python programming language.
MonkeyType - A Python library that generates static type annotations by collecting runtime types
chruby - Changes the current Ruby
hpy - HPy: a better API for Python
sbcl - Mirror of Steel Bank Common Lisp (SBCL)'s official repository
Nuitka - Nuitka is a Python compiler written in Python. It's fully compatible with Python 2.6, 2.7, 3.4, 3.5, 3.6, 3.7, 3.8, 3.9, 3.10, and 3.11. You feed it your Python app, it does a lot of clever things, and spits out an executable or extension module.