cibuildwheel
rattler
cibuildwheel | rattler | |
---|---|---|
8 | 3 | |
1,726 | 214 | |
1.4% | 7.5% | |
9.3 | 9.6 | |
5 days ago | 4 days ago | |
Python | Rust | |
GNU General Public License v3.0 or later | BSD 3-clause "New" or "Revised" License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
cibuildwheel
-
Balm in GILead: Fast string construction for CPython extensions
It doesn't work with any version of the public API, Limited, Stable, or Unstable, because this is not a part of the API. It's more of an application of [Hyrum's Law](https://www.hyrumslaw.com/).
That said, assuming the structures themselves exist on the versions of Python you're targeting in a format compatible with whatever hacking you're doing on them, it's very easy to compile for lots of Python versions using [cibuildwheel](https://github.com/pypa/cibuildwheel) and the rest of the PyPA ecosystem.
I don't think the Limited API is very useful, as a practical matter for the common distribution methods you need the wheel to be built with the target Python version.
-
Rip – Rust crate to resolve and install Python packages
pypa/cibuildwheel: https://github.com/pypa/cibuildwheel :
> Example setup: To build manylinux, musllinux, macOS, and Windows wheels on GitHub Actions, you could use this .github/workflows/wheels.yml
-
Bundling binary tools in Python wheels
> size of wheels you can upload is constrained by PyPi
I feel PyPi is pretty generous with their limits. You can even request more once you hit the ceiling, i think it’s around 60MB [1]. There are some wheels that are crazy large, tensorflow-gpu [2] are around 500MB each. I think there’s discussions out there to try and find ways of alleviating this problem on PyPi.
> difficult to support multiple versions across multiple operating systems, unless you provide a source distribution, which is then…
This can be a problem but I’ve found that recently the problem has improved quite a lot. You can create manylinux wheels for both x86, x64, and arm64 which cover pretty a lot of the Linux distributions using glibc. A musllinux tag was recently added to cover musl based distributions like Alpine. MacOS wheels support both x64, arm64, and can even be a universal2 wheel. Windows is still purely x86 or x64 for now but I’ve seen some people work on arm64 support support in CPython and once that’s in I’m sure PyPi won’t be too far around. There are also some great tools like cibuildwheel [3] that make building and testing these wheels pretty simple.
> Still a nightmare on Windows
I’m actually curious what is a nightmare about Windows. I found that Windows is probably the easiest of all the platforms to build and upload wheels for. You aren’t limited to a tiny subset of system libs, like you are on Linux, and building them is mostly the same process. Probably the hardest thing is ensuring you have tue correct vs build kit installed but that’s not insurmountable.
[1] https://pypi.org/help/#file-size-limit
[2] https://pypi.org/project/tensorflow-gpu/#files
[3] https://github.com/pypa/cibuildwheel
- cibuildwheel added support for building wheels on CPython 3.11
-
Using GitHub Action to Build Python Wheel Package for Dynamsoft C++ Barcode SDK
Click set up a workflow yourself to create a custom workflow. We can refer to the examples provided by cibuildwheel.
- Cibuildwheel: Build Python wheels for all the platforms on CI
- 🎡 cibuildwheel: Build Python wheels for 55 different platform/CPU/ABI combinations with minimal configuration
rattler
- Rip – Rust crate to resolve and install Python packages
-
What are you rewriting in rust?
I was in a similar situation. Started a libray to work with the conda ecosystem called rattler. Then it become my day job.
-
The magic of dependency resolution
There is semi working version of a pubgrub implementation in a branch in rattler if you wanna give it a try. :D
What are some alternatives?
tox - Command line driven CI frontend and development task automation tool.
rip - A safe and ergonomic alternative to rm
twisted-iocpsupport - `twisted-iocpsupport` is an extension module for the Twisted `iocp` reactor to use the Windows I/O Completion Ports (IOCP) networking API. You should not need to install it directly or interact with its API; it is a dependency of Twisted on Windows platforms.
tink-rust - Rust port of Tink cryptography library
releasezri - Meaningful and minimalist release notes for developers
MediaTracker - Self hosted media tracker for movies, tv shows, video games, books and audiobooks
twine - Utilities for interacting with PyPI
rich - Rich is a Python library for rich text and beautiful formatting in the terminal.
easierlog - The easy way to inspect variables in Python.
fml9000 - work in progress music player with Rust+GTK4
megalinter - 🦙 MegaLinter analyzes 50 languages, 22 formats, 21 tooling formats, excessive copy-pastes, spelling mistakes and security issues in your repository sources with a GitHub Action, other CI tools or locally.
gitoxide - An idiomatic, lean, fast & safe pure Rust implementation of Git