Python Memory

Open-source Python projects categorized as Memory

Top 20 Python Memory Projects

  • memray

    The endgame Python memory profiler

    Project mention: Microservice memory profiling | /r/FastAPI | 2023-05-28

    second time was nastier. I used https://github.com/bloomberg/memray to try to spot it - that's the tool you should try out. You load your service through memray, and it will get you some stats that you can export as a flamegraph. I can't really afford to make it run on production so I ran it in a docker image and repeatedly ran the scenario I thought was responsible. Didn't find anything. I know what I did wrong: I assumed one particular codepath was the problem. If would have find the issue if I had a really complete scenario that covers broadly every possible endpoint and condition. Can't blame memray, that tool is really promising.

  • psutil

    Cross-platform lib for process and system monitoring in Python

    Project mention: Single Window Mode when Firefox is already launched with -profile "my_profile" parameter | /r/firefox | 2023-04-20

    fyi: python + https://github.com/giampaolo/psutil is pretty portable

  • InfluxDB

    Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.

  • volatility

    An advanced memory forensics framework

    Project mention: What is the appropriate uncompressed kernel ELF to use with dwarf2json? [ 5.19.0-42-generic #43~22.04.1-Ubuntu ], in order to create generate a custom symbols table to conduct linux memory forensics on Ubuntu 22.04? | /r/computerforensics | 2023-05-28

    I need this to create generate a custom symbols table (using dwarf2json), in order to run a memory dump acquired by Ubuntu 22.04, as Ubuntu 22.04 kernel does not work anymore with volatility 2 (Issue here: volatilityfoundation/volatility#828)

  • volatility3

    Volatility 3.0 development

    Project mention: Volatility 3 2.4.1 - New Linux and Windows plugins | /r/blueteamsec | 2023-04-22
  • promnesia

    Another piece of your extended mind

    Project mention: Update 4: RedReader granted non-commercial accessibility exemption | /r/RedReader | 2023-06-09

    Promnesia & theconversation.social were on similar themes/solutions.

  • ps_mem

    A utility to accurately report the in core memory usage for a program

    Project mention: Why is it using that much ram? Is that a trojan? Is that a feature of the linux-tkg kernel? (nothing else is running in the background) | /r/linuxmasterrace | 2023-07-01

    I use a script I call memtop10.sh that uses a combination of ps and ps_mem.py which you can find here: https://github.com/pixelb/ps_mem/blob/master/ps_mem.py

  • memorizing-transformers-pytorch

    Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch

    Project mention: A single API call using almost the whole 32k context window costs around 2$. | /r/OpenAI | 2023-03-15

    There is a GitHub repo https://github.com/lucidrains/memorizing-transformers-pytorch the implementation deviates from the paper slightly, using a hybrid attention across attention logits local and distant (rather than the sigmoid gate setup). It also uses cosine similarity attention (with learned temperature) for the KNN attention layer. There are also some features that are not mentioned in the paper, such as Transformer-XL memories and shifting memories down. There are no easy-to-use Memorizing Transformers implementations yet.

  • Onboard AI

    Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.

  • MalConfScan

    Volatility plugin for extracts configuration data of known malware

  • recurrent-memory-transformer-pytorch

    Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch

    Project mention: The race is on | /r/LocalLLaMA | 2023-04-24

    Of course, lucidrains already has an empty repo up. So that's worth keeping an eye on.

  • gpt-voice-conversation-chatbot

    Allows you to have an engaging and safely emotive spoken / CLI conversation with the AI ChatGPT / GPT-4 while giving you the option to let it remember things discussed.

    Project mention: How to protect against prompt injection in a web app? | /r/OpenAI | 2023-03-12
  • block-recurrent-transformer-pytorch

    Implementation of Block Recurrent Transformer - Pytorch

    Project mention: From Deep to Long Learning | news.ycombinator.com | 2023-04-09

    that line of research is still going. https://github.com/lucidrains/block-recurrent-transformer-py... i think it is worth continuing research on both fronts.

  • memprof

    A memory profiler for Python. As easy as adding a decorator!

  • checkmate

    Training neural networks in TensorFlow 2.0 with 5x less memory (by parasj)

  • Proxmox-load-balancer

    Designed to constantly maintain the Proxmox cluster in balance

  • HTM-pytorch

    Implementation of Hierarchical Transformer Memory (HTM) for Pytorch

  • cacheme

    Asyncio cache framework for Python

    Project mention: Python deserves a good in-memory cache library! | /r/Python | 2023-02-08

    Also if you are looking for a good cache framework, maybe Cacheme can help you.

  • memory-hammer

    An always-on Anki review system.

    Project mention: Memory Hammer: An e-ink, always-on, OSS spaced repetition system | news.ycombinator.com | 2023-04-12
  • pyheap

    A heap dumper and analyzer for CPython based on GDB

    Project mention: Show HN: PyHeap – A heap dumper and analyzer for CPython based on GDB | news.ycombinator.com | 2022-12-12
  • PyMemoryEditor

    :floppy_disk: Multi-platform library developed with ctypes for reading, writing and searching process memory, in a simple and friendly way with Python 3. The package supports Windows and Linux (32-bit and 64-bit).

    Project mention: Library for Memory Scanning for Python 3 (with a GUI application) | /r/Python | 2023-11-29

    The code is on my GitHub->JeanExtreme002/PyMemoryEditor. I would also appreciate if you left a ⭐️ on the repository page if you like the project and want to see more updates!

  • dask-memusage

    A low-impact profiler to figure out how much memory each task in Dask is using

  • SaaSHub

    SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives

NOTE: The open source projects on this list are ordered by number of github stars. The number of mentions indicates repo mentiontions in the last 12 Months or since we started tracking (Dec 2020). The latest post mention was on 2023-11-29.

Python Memory related posts

Index

What are some of the best open-source Memory projects in Python? This list will help you:

Project Stars
1 memray 11,503
2 psutil 9,677
3 volatility 6,636
4 volatility3 1,907
5 promnesia 1,630
6 ps_mem 1,454
7 memorizing-transformers-pytorch 591
8 MalConfScan 460
9 recurrent-memory-transformer-pytorch 356
10 gpt-voice-conversation-chatbot 248
11 block-recurrent-transformer-pytorch 185
12 memprof 127
13 checkmate 119
14 Proxmox-load-balancer 116
15 HTM-pytorch 69
16 cacheme 36
17 memory-hammer 29
18 pyheap 28
19 PyMemoryEditor 26
20 dask-memusage 24
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com