memory_profiler
Cython
memory_profiler | Cython | |
---|---|---|
6 | 79 | |
4,222 | 8,935 | |
0.6% | 1.3% | |
3.7 | 9.8 | |
7 days ago | 4 days ago | |
Python | Python | |
GNU General Public License v3.0 or later | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
memory_profiler
- Ask HN: C/C++ developer wanting to learn efficient Python
-
8 Most Popular Python HTML Web Scraping Packages with Benchmarks
memory_profiler
-
Check Python Memory Usage
pythonprofilers/memory_profiler: Monitor Memory usage of Python code
-
Profiling and Analyzing Performance of Python Programs
# https://github.com/pythonprofilers/memory_profiler pip install memory_profiler psutil # psutil is needed for better memory_profiler performance python -m memory_profiler some-code.py Filename: some-code.py Line # Mem usage Increment Occurrences Line Contents ============================================================ 15 39.113 MiB 39.113 MiB 1 @profile 16 def memory_intensive(): 17 46.539 MiB 7.426 MiB 1 small_list = [None] * 1000000 18 122.852 MiB 76.312 MiB 1 big_list = [None] * 10000000 19 46.766 MiB -76.086 MiB 1 del big_list 20 46.766 MiB 0.000 MiB 1 return small_list
-
Profiling Python code with memory_profiler
What do you do when your Python program is using too much memory? How do you find the spots in your code with memory allocation, especially in large chunks? It turns out that there is not usually an easy answer to these question, but a number of tools exist that can help you figure out where your code is allocating memory. In this article, I’m going to focus on one of them, memory_profiler.
- What Is Your Favorite Profilerperformance Tool
Cython
- Ask HN: C/C++ developer wanting to learn efficient Python
- Ask HN: Is there a way to use Python statically typed or with any type-checking?
- Cython 3.0
-
How to make a c++ python extension?
The approach that I favour is to use Cython. The nice thing with this approach is that your code is still written as (almost) Python, but so long as you define all required types correctly it will automatically create the C extension for you. Early versions of Cython required using Cython specific typing (Python didn't have type hints when Cython was created), but it can now use Python's type hints.
-
Never again
and again, everything that was released after using an older version of cython.
-
Codon: Python Compiler
Just for reference,
* Nuitka[0] "is a Python compiler written in Python. It's fully compatible with Python 2.6, 2.7, 3.4, 3.5, 3.6, 3.7, 3.8, 3.9, 3.10, and 3.11."
* Pypy[1] "is a replacement for CPython" with builtin optimizations such as on the fly JIT compiles.
* Cython[2] "is an optimising static compiler for both the Python programming language and the extended Cython programming language... makes writing C extensions for Python as easy as Python itself."
* Numba[3] "is an open source JIT compiler that translates a subset of Python and NumPy code into fast machine code."
* Pyston[4] "is a performance-optimizing JIT for Python, and is drop-in compatible with ... CPython 3.8.12"
[0] https://github.com/Nuitka/Nuitka
[1] https://www.pypy.org/
[2] https://cython.org/
[3] https://numba.pydata.org/
[4] https://github.com/pyston/pyston
- Slow Rust Compiler is a Feature, not a Bug.
-
Any faster Python alternatives?
Profile and optimize the hotspots with cython (or whatever the cool kids are using these days... It's been a while.)
-
What exactly is 'JIT'?
JIT essentially means generating machine code for the language on the fly, either during loading of the interpreter (method JIT), or by profiling and optimizing hotspots (tracing JIT). The language itself can be statically or dynamically typed. You could also compile a dynamic language ahead of time, for example, cython.
-
Python executable makers
Cython - - embed demo
What are some alternatives?
py-spy - Sampling profiler for Python programs
SWIG - SWIG is a software development tool that connects programs written in C and C++ with a variety of high-level programming languages.
line_profiler
PyPy
profiling
mypyc - Compile type annotated Python to fast C extensions
pyflame
Pyston - A faster and highly-compatible implementation of the Python programming language.
Laboratory - Achieving confident refactoring through experimentation with Python 2.7 & 3.3+
Stackless Python
filprofiler - A Python memory profiler for data processing and scientific computing applications
Pyjion