mitogen
PyOxidizer
mitogen | PyOxidizer | |
---|---|---|
11 | 28 | |
2,259 | 5,206 | |
1.0% | - | |
8.2 | 0.0 | |
3 days ago | about 2 months ago | |
Python | Rust | |
BSD 3-clause "New" or "Revised" License | Mozilla Public License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
mitogen
-
Two File Descriptors for Sockets
Ran into a variant of this when working on an IO loop, ended up with a little "Side" abstraction to wrap bidirectional/unidirectional descriptors to behave identically for the rest of the library. It's an annoying wart but pretty easy to avoid in userspace.. https://github.com/mitogen-hq/mitogen/blob/798032b9/mitogen/...
-
Mitogen speedup (the actual value)
It's an odd piece of code for 'self-replicating', and I'd say is a bit of obscure project, but it has something amazing: alternative strategies for Ansible to speedup playbooks. It's rough, badly supported, requires patching to run on modern Ansible versions, and you are on your own if you use it, but it's so fast, that's it's impossible to drop. https://mitogen.networkgenomics.com/
-
Benchmarking ansible-core 2.11 vs 2.14 and python 3.9 vs 3.11 along with ara's database backends
I'm not sure how to interpret running 100 debug messages (https://github.com/ansible-community/ara/blob/master/tests/integration/benchmark_tasks.yaml) into real life performance. Mitogen's Benchmark used either 100 times a "hostname" command on the target machine (https://github.com/mitogen-hq/mitogen/blob/master/tests/ansible/bench/loop-100-items.yml) or running the DebOps project (https://github.com/debops/debops-playbooks/blob/master/playbooks/common.yml) for some sorta real-world module usage.
- Mitogen is a Python library for writing distributed self-replicating programs
-
Summary unreachable Hosts at end of Playbook
You can try to decrease the amount of failed connections w mitogen: https://github.com/mitogen-hq/mitogen/tags
-
Surprisingly Slow
It could use a Queue of some kind rather than just pushing onto a deque between threads [1]? Then it would idly wait for the results_thread_main to push results.
I guess that might be what Mitogen does, a faster Ansible strategy. https://github.com/mitogen-hq/mitogen/blob/master/docs/ansib...
[1] https://github.com/ansible/ansible/blob/becf9416736dc911d341...
-
Ansible, Mitogen, Collections/Plugins
Yes, I use ansible-base + manually installed collections and mitogen works with both fully qualified module names as well as the short version. Should work since last year actually: https://github.com/mitogen-hq/mitogen/releases/tag/v0.3.0-rc.0
- RFC Sustainability of Mitogen project · Issue #773 · dw/mitogen
-
RFC: Sustainability of Mitogen, an Ansible accelerator
dw did make a comment there, but its definitely got a disgruntled attitude.
PyOxidizer
-
Show HN: Pywebview 5
Bundling Python isn't too bad if you find the right tools for it.
I really like https://github.com/indygreg/python-build-standalone and https://github.com/indygreg/PyOxidizer
A bundled, built standalone Python can be 16 to 32MB (including the full standard library, which you can strip down to just the bits you use to save size). Not tiny, but probably not worth switching programming languages over.
-
Why do you enjoy systems programming languages?
But really, I would suggest thinking about what you want to build before "how" or "with which tool" - one of the signs of a person becoming a good engineer is having an array of tools at their disposal and being able to choose a correct tool for the correct task. Rust also excels in integrating with other languages - with JS via WebAssembly (a bit of self-promotion, for example), with Elixir via Rustler, with Python via PyO3 and PyOxidizer, etc. So you absolutely can start writing a frontend app with JS, or a distributed system with Elixir, or a data processing/ML app with Python and use Rust to speed up critical parts of those. Or, in reverse, you can start with Rust & add new capabilities to whatever you're building, that being a frontend, a resilient chat interface, or an ML model.
-
List of Python compilers
Thank you, although this is not exactly on topic. I'd not heard of PyOxidizer, but it appears to have the same goal as PyInstaller, py2exe, and cx_Freeze -- as the PyOxidizer readme says, it produces
-
Buck2, a large scale build tool written in Rust by Meta, is now available
Here is some example Github Action from PyOxidizer as a Kickstarter: https://github.com/indygreg/PyOxidizer/blob/main/.github/workflows/build-exe.yml
-
Mitogen speedup (the actual value)
A starting point to try out binary modules by the way would be https://github.com/indygreg/PyOxidizer - could already have benefits by rolling in all dependencies of modules (so no more pip/apt/dnf/... installs on target hosts). Setting this up should be relatively straightforward and could probably be automated enough to even manage to build binary modules for all modules in the community ansible distribution eventually.
- Python Magic Methods You Haven’t Heard About
-
What are different ways to make a Python exe besides py-to-exe?
PyOxidizer might be another option.
- Used "Py To EXE" and It Showed KeyLogger as One of Viruses
- indygreg / PyOxidizer :
-
A Completely Open-Source Implementation of Apple Code Signing and Notarization
XAR signing is effectively just an RFC 5652 CMS signature plus some minimal data structure manipulation. Code at https://github.com/indygreg/PyOxidizer/blob/faa7dfcea5d66bf5....
Mach-O and bundles, by contrast, require a myriad of additional data structures requiring thousands of lines of code to support. To my knowledge, nobody else has implemented signing of these far-more-complicated primitives. (Existing Mach-O signing solutions just do ad-hoc signing and/or don't handle Mach-O in the context of a bundle.)
What are some alternatives?
Ansible - Ansible is a radically simple IT automation platform that makes your applications and systems easier to deploy and maintain. Automate everything from code deployment to network configuration to cloud management, in a language that approaches plain English, using SSH, with no agents to install on remote systems. https://docs.ansible.com.
PyInstaller - Freeze (package) Python programs into stand-alone executables
ceph-cm-ansible - Ansible configurations for Ceph.com infrastructure
Nuitka - Nuitka is a Python compiler written in Python. It's fully compatible with Python 2.6, 2.7, 3.4, 3.5, 3.6, 3.7, 3.8, 3.9, 3.10, and 3.11. You feed it your Python app, it does a lot of clever things, and spits out an executable or extension module.
javaslang-circuitbreaker - Resilience4j is a fault tolerance library designed for Java8 and functional programming
pyarmor - A tool used to obfuscate python scripts, bind obfuscated scripts to fixed machine or expire obfuscated scripts.
Mosh - Mobile Shell
pynsist - Build Windows installers for Python applications
crustaceans - Travis / GitHub Pages powered lobste.rs community planet instance
py2exe - modified py2exe to support unicode paths
volkswagen - :see_no_evil: Volkswagen detects when your tests are being run in a CI server, and makes them pass.
dh-virtualenv - Python virtualenvs in Debian packages