Top 20 Python Cython Projects
-
SpaCy is one of the most popular NLP libraries, and is very fast and flexible.
-
Comparatively faster because of Cython support
-
OPS
OPS - Build and Run Open Source Unikernels. Quickly and easily build and deploy open source unikernels in tens of seconds. Deploy in any language to any cloud.
-
We of cause, like all good developers do, put the error message online and look for clues, we quickly found a GitHub issue and boi, we are not the only souls that got crushed by a "timely" release of virtualenv just a few hours before us. Since the lastest version of virtualenv got installed every time we create the CI build job on Travis, it fails even we have done nothing. Of cause we didn't point fingers at other maintainers, they are just as hardworking as us and it's human to make mistakes. We are faced with 2 options, roll back to the previous release or wait for the patch of virtualenv to get released. As the devs of virtualenv did a lighting fast patch, we have chosen option 2.
-
Project mention: My emulator runs Pokemon Red without any issues! | reddit.com/r/EmuDev | 2021-10-07
You can read my report on how PyBoy came along. It's not for technical reference like the Pan Docs, but just light descriptions of the Game Boy hardware with the intention to emulate it https://github.com/Baekalfen/PyBoy/raw/master/PyBoy.pdf
-
Project mention: Better alternative to gdal_translate [cross posted with r/QGIS] | reddit.com/r/gis | 2022-01-12
Looks like rio (Rasterio CLI) also uses gdal libraries. https://github.com/rasterio/rasterio/blob/master/rasterio/rio/clip.py
-
Project mention: [Question] I am trying to segment the image using python. | reddit.com/r/opencv | 2021-08-09
If you’re using tesserocr then you can use OpenCV images directly, so you can just extract the relevant image rows (e.g. query_image = main_image[prev_line:this_line]) and process then without needing to save each image.
-
VidCutter: https://github.com/ozmartian/vidcutter
-
Scout APM
Less time debugging, more time building. Scout APM allows you to find and fix performance issues with no hassle. Now with error monitoring and external services monitoring, Scout is a developer's best friend when it comes to application development.
-
There are also online & offline onset detection approaches available as part of the Python madmom library https://github.com/CPJKU/madmom as binaries and Python classes. The methods included in madmom have shown state of the art results in multiple Music Information Retrieval Evaluation eXchange (MIREX) campaigns in recent years. Hope that's useful to you.
-
Project mention: Nimporter – Compile Nim Extensions for Python on Import | reddit.com/r/CKsTechNews | 2022-01-23
-
Project mention: [D] Unsupervised document similarity state of the art | reddit.com/r/MachineLearning | 2021-04-09
Links: fse: https://github.com/oborchers/Fast_Sentence_Embeddings Sentence-transformers: https://github.com/oborchers/sentence-transformers
-
Project mention: I hear about Python being slow, but when has performance actually been an issue for you? | reddit.com/r/Python | 2021-04-21
Taking a quick look, PySPH looks pretty good... actually, this looks way, way better than what was around last time I looked! I haven't seen any validation tests in their examples yet, but overall the results look promising. Looks like you may still have to write quite a bit of code to get the simulation set up, but at least you won't have to write your own solver.
-
LSH
Locality Sensitive Hashing using MinHash in Python/Cython to detect near duplicate text documents
-
-
For example here's a Python project modified to work well on Cython - I think that's pretty substantially modified.
-
Project mention: asyncmy, an asyncio MySQL driver accelerated by cython | reddit.com/r/Python | 2021-03-15
Repo: https://github.com/long2ice/asyncmy
-
drf-turbo
An alternative serializer implementation for REST framework written in cython built for speed.
Project mention: GitHub - Mng-dev-ai/drf-turbo: An alternative serializer implementation for REST framework written in cython built for speed. | reddit.com/r/django | 2021-11-10 -
cpython
Alternative StdLib for Nim for Python targets, hijacks Python StdLib for Nim (by juancarlospaco)
Project mention: Nim to write Python modules ? What about memory management ? | reddit.com/r/nim | 2021-10-14What if I have a python object that contains Nim-managed pointers to nim objects that contain Python objects created by Nim's CPython ? How will GC(s) work ?
-
Project mention: Julia is the better language for extending Python | news.ycombinator.com | 2021-04-19
Rust doesn’t need to copy the data. It’s trivial to pass e.g. Numpy arrays to Rust as slices via Cython (let alone originating in Cython!), modify them, and return them, or use them as input for a new returned struct.
https://github.com/urschrei/simplification
https://github.com/urschrei/lonlat_bng
https://github.com/urschrei/pypolyline
Each of those repos has links to the corresponding Rust “shim” libraries that provide FFIs for dealing with the incoming data, constructing Rust data structures from it, and then transforming it back on the way out.
As a more general comment, using a GC language as the FFI target from a GC language is begging for difficult-if-not-impossible-to-debug crashes down the line.
-
With Cython you can get C level performance. The cost is that your Python code has to be written just as you would write C.
See e.g. https://github.com/thomasahle/fast_pq/blob/main/_fast_pq.pyx... for how much fast Cython code can look like C.
-
python-performance
Repository for the book High Performance Python for Data Analytics - published by Manning
All the code referred here can be found in https://github.com/tiagoantao/python-performance/tree/master/05-cython/sec6-quadlife
Python Cython related posts
- 5 NLP Libraries Everyone Should Know
- Can't python be translated to other languages?
- Pyjion – A Python JIT Compiler
- why can't you compile an interpreted language?
- How is python able to use c code?
- Is there a language that converts to C++ that allows you to make your life easier with the syntax?
- Static typing like C
Index
What are some of the best open-source Cython projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | spaCy | 22,251 |
| 2 | Cython | 6,679 |
| 3 | virtualenv | 4,037 |
| 4 | PyBoy | 3,358 |
| 5 | rasterio | 1,657 |
| 6 | tesserocr | 1,587 |
| 7 | vidcutter | 967 |
| 8 | madmom | 850 |
| 9 | nimporter | 578 |
| 10 | Fast_Sentence_Embeddings | 478 |
| 11 | pysph | 265 |
| 12 | LSH | 208 |
| 13 | Streaming multipart/form-data parser | 102 |
| 14 | nes | 88 |
| 15 | asyncmy | 80 |
| 16 | drf-turbo | 65 |
| 17 | cpython | 62 |
| 18 | pypolyline | 18 |
| 19 | fast_pq | 4 |
| 20 | python-performance | 3 |
Are you hiring? Post a new remote job listing for free.
