ideas
cinder
Our great sponsors
| ideas | cinder | |
|---|---|---|
| 81 | 43 | |
| 1,647 | 3,371 | |
| 1.0% | 0.7% | |
| 7.3 | 9.4 | |
| about 2 months ago | 6 days ago | |
| Python | ||
| - | GNU General Public License v3.0 or later |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
ideas
-
Type information for faster Python C extensions
Lower latency native calls in Python would be extremely useful, thank you for your work! Is the following GitHub issue the right place to monitor progress? https://github.com/faster-cpython/ideas/issues/546
I'm open to doing some benchmarking. Several of my libraries have pure CPython bindings (StringZilla, UCall, SimSIMD), and all perform low-latency SIMD-accelerated ops, so might be a good testing ground :)
-
How Many Lines of C It Takes to Execute a and B in Python?
Recent CPython development has been towards optimizations and addressing use cases that benefit from optimizations, some coming from the faster CPython initiative. You might just get your JIT[1].
[1] https://github.com/faster-cpython/ideas/wiki/Workflow-for-3....
-
GIL removal and the Faster CPython project
The faster-cpython folks seem to be working towards a JIT (https://github.com/faster-cpython/ideas/tree/main/3.13) and both pyston and cinder have JITs. So I don't think anyone has ruled one out.
-
Our Plan for Python 3.13
faster-cpython team has done a lot of work to experiment on it: https://github.com/faster-cpython/ideas/issues/485#issuecomm...
It kind of sounds like migration to register based is a foregone conclusion, but it's not very clear to me.
-
Faster CPython at PyCon, part two
lots of big ideas are still remaining to be done. One example is the register based interpreter, see https://github.com/faster-cpython/ideas/issues/485
A previous plan called for the beginning of a JIT in 3.12, seen as "Trace optimized interpreter" here: https://github.com/faster-cpython/ideas/wiki/Workflow-for-3....
- EdgeDB – A graph-relational database built on top of Postgres
- Python 3.12 Nogil Benchmark
cinder
-
Meta Used Monolithic Architecture to Ship Threads in Only Five Months
Meta is actually contributing directly to upstream cpython. If you really wanted to, the internal fork is also open source: https://github.com/facebookincubator/cinder
- Meta pledges Three-Year sponsorship for Python if GIL removal is accepted
- Back end of Meta Threads is built with Python 3.10 with some interesting tweaks
-
Lessons from Mojo for PHP 10+ ?
Just one example: last year Meta open-sourced Cinder, which powers Instagram and provides sizeable speedups compared to CPython.
- Python true static typing
-
Best book on writing an optimizing compiler (inlining, types, abstract interpretation)?
I used to work on the Cinder JIT and can help document any passes you find interesting or confusing.
-
Python-based compiler achieves orders-of-magnitude speedups
You might enjoy Cinder then. It's based on CPython so it is nearly 100% compatible.
https://github.com/facebookincubator/cinder/
Disclaimer: I used to work on it.
-
beartype: It has documentation now. It only took two years, my last hair follicle, precious sanity points (SPs), and working with Sphinx. Don't be like @leycec. Go hard on documentation early.
I think Cinder's Static Python, which also performs runtime type checking, is more ambitious. Though it's not production ready yet.
-
If there’s gonna be a Python 4.0 one day, what’s a breaking change you’d like to see? Let’s explore the ideas you have that can make Python even better!
Here's a fork that implements that https://github.com/facebookincubator/cinder - it might be nice to one day get that up streamed but obviously it'll be controversial and it certainly needs more time to bake. Hopefully at some point we can make it a pip installable extension though.
-
Is it time for Python to have a statically-typed, compiled, fast superset?
The other thing that was interesting to me, was the potential of type annotations to help make for a faster, safer experience on the compiler end of things. One example is seen in Meta’s Cinder project, on the docs it explains how typing can be used to reduce the number of steps for the compiler ([cinder/static_python.rst at cinder/3.8 · facebookincubator/cinder · GitHub](https://github.com/facebookincubator/cinder/blob/cinder/3.8/CinderDoc/static_python.rst)), making it more effective.
What are some alternatives?
Nuitka - Nuitka is a Python compiler written in Python. It's fully compatible with Python 2.6, 2.7, 3.4, 3.5, 3.6, 3.7, 3.8, 3.9, 3.10, and 3.11. You feed it your Python app, it does a lot of clever things, and spits out an executable or extension module.
faster-cpython - How to make CPython faster.
Pyjion - Pyjion - A JIT for Python based upon CoreCLR
Pyjion
nogil - Multithreaded Python without the GIL
graalpython - A Python 3 implementation built on GraalVM
pyenv-virtualenv - a pyenv plugin to manage virtualenv (a.k.a. python-virtualenv)
MonkeyType - A Python library that generates static type annotations by collecting runtime types
jnumpy - Writing Python C extensions in Julia within 5 minutes.
hpy - HPy: a better API for Python