pybind11 VS py2many

I have a python module for which the logic is written in C++ and I use pybind11 to expose the objects and functions to Python.

Reading from Python requires a wrapper, using pybind11 this is fairly done.

That said, if you need to write a Python module in a compiled language, it's much easier and more fun these days to write in C++. pybind11 is extremely mature and even fun system to write Python objects in C++.

There will be specific technologies you used in your data pipelining: Parquet? Did you use Pandas to manipulate your data? Did you optimise some aspects with C++? If so did you use PyBind11 to integrate it?

git clone https://github.com/pybind/pybind11.git

I would say that pybind11 is precisely what you want here. If you don’t want to write the bindings yourself, you could try Tolc.

Pybind11 https://github.com/pybind/pybind11 is an easy way to expose c++ functions in python.

I think they should give up on Flutter for Web and just focus on mobile and desktop (and maybe extend use on Smart Watches, Smart TV, embedded instead). Too many people still remember Java Applets, google's GWT, Flash/Flex and how it ended. They are out of focus trying to support Web as well.

I had also higher expectation regarding Dart FFI - I think with their ffigen we are still only in ctypes like python bindings territory. Nowhere near something like pybind11 [0] for c++ bindings yet.

[0] https://github.com/pybind/pybind11

[1] https://github.com/mozilla/uniffi-rs

And how to do this in the best modern way instead of dealing with Pythons native and annoying 30 year old C API: https://github.com/pybind/pybind11

Some work on the C++ side will be required. There's https://github.com/pybind/pybind11 for example.

https://github.com/py2many/py2many/blob/main/doc/langspec.md

Reimplement a large enough, commonly used subset of python stdlib using this dialect and we may be in the business of writing cross platform apps (perhaps start with android and Ubuntu/Gnome)

For py2many, there is an informal specification here:

https://github.com/py2many/py2many/blob/main/doc/langspec.md

Would be great if all the authors of "python-like" languages get together and come up with a couple of specs.

I say a couple, because there are ones that support the python runtime (such as cython) and the ones which don't (like py2many).

It'd not fully solve your issue, but have you ever seen https://github.com/py2many/py2many ?

Cython doesn't consume python3 type hints and needs special type hints of its own. But it's certainly more mature than other players in the field.

What we need is a rpython suitable for app programming and a stdlib written in that dialect.

https://github.com/py2many/py2many/blob/main/doc/langspec.md

No intermediate AST. To understand the various stages of transpilation and separation of language specific and independent rewriters, this file is a good starting point:

https://github.com/adsharma/py2many/blob/main/py2many/cli.py...

This is awesome! The direction of using a subset of python, while leveraging the user base and static typing to accomplish some other everyday task in a different language is very legit IMO.

I took a cursory look at:

https://github.com/zanellia/prometeo/blob/master/prometeo/cg...

It seems quite similar in spirit to

https://github.com/adsharma/py2many/blob/main/pyrs/transpile...

I'm not spending much time on py2many last few months (started a new job). Let me know if any of it sounds useful - especially the ability to transpile to 7-8 languages including Julia, C++ and Rust.

Link to the test that's relevant for this discussion:

https://github.com/adsharma/py2many/blob/main/tests/cases/in...

This is an explicit deviation from python's bigint, which doesn't map very well to systemsey languages. The next logical step is to build on this to have dependent and refinement types.

Work in progress here:

https://github.com/adsharma/Typpete

If you stick to this subset of python

https://github.com/adsharma/py2many/blob/main/doc/langspec.m...

The tool can convert your code to C++/Rust/Go and give you a native binary which like you observe will run faster without the python runtime.

There are many open tasks that could use help.