Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge. Learn more →
Top 20 Python Memory Projects
The endgame Python memory profilerProject mention: Microservice memory profiling | /r/FastAPI | 2023-05-28
second time was nastier. I used https://github.com/bloomberg/memray to try to spot it - that's the tool you should try out. You load your service through memray, and it will get you some stats that you can export as a flamegraph. I can't really afford to make it run on production so I ran it in a docker image and repeatedly ran the scenario I thought was responsible. Didn't find anything. I know what I did wrong: I assumed one particular codepath was the problem. If would have find the issue if I had a really complete scenario that covers broadly every possible endpoint and condition. Can't blame memray, that tool is really promising.
Cross-platform lib for process and system monitoring in PythonProject mention: Single Window Mode when Firefox is already launched with -profile "my_profile" parameter | /r/firefox | 2023-04-20
fyi: python + https://github.com/giampaolo/psutil is pretty portable
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
An advanced memory forensics frameworkProject mention: What is the appropriate uncompressed kernel ELF to use with dwarf2json? [ 5.19.0-42-generic #43~22.04.1-Ubuntu ], in order to create generate a custom symbols table to conduct linux memory forensics on Ubuntu 22.04? | /r/computerforensics | 2023-05-28
I need this to create generate a custom symbols table (using dwarf2json), in order to run a memory dump acquired by Ubuntu 22.04, as Ubuntu 22.04 kernel does not work anymore with volatility 2 (Issue here: volatilityfoundation/volatility#828)
Volatility 3.0 developmentProject mention: Volatility 3 2.4.1 - New Linux and Windows plugins | /r/blueteamsec | 2023-04-22
Another piece of your extended mindProject mention: Update 4: RedReader granted non-commercial accessibility exemption | /r/RedReader | 2023-06-09
Promnesia & theconversation.social were on similar themes/solutions.
A utility to accurately report the in core memory usage for a programProject mention: Why is it using that much ram? Is that a trojan? Is that a feature of the linux-tkg kernel? (nothing else is running in the background) | /r/linuxmasterrace | 2023-07-01
I use a script I call memtop10.sh that uses a combination of ps and ps_mem.py which you can find here: https://github.com/pixelb/ps_mem/blob/master/ps_mem.py
Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in PytorchProject mention: A single API call using almost the whole 32k context window costs around 2$. | /r/OpenAI | 2023-03-15
There is a GitHub repo https://github.com/lucidrains/memorizing-transformers-pytorch the implementation deviates from the paper slightly, using a hybrid attention across attention logits local and distant (rather than the sigmoid gate setup). It also uses cosine similarity attention (with learned temperature) for the KNN attention layer. There are also some features that are not mentioned in the paper, such as Transformer-XL memories and shifting memories down. There are no easy-to-use Memorizing Transformers implementations yet.
Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.
Volatility plugin for extracts configuration data of known malware
Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in PytorchProject mention: The race is on | /r/LocalLLaMA | 2023-04-24
Of course, lucidrains already has an empty repo up. So that's worth keeping an eye on.
Allows you to have an engaging and safely emotive spoken / CLI conversation with the AI ChatGPT / GPT-4 while giving you the option to let it remember things discussed.Project mention: How to protect against prompt injection in a web app? | /r/OpenAI | 2023-03-12
Implementation of Block Recurrent Transformer - PytorchProject mention: From Deep to Long Learning | news.ycombinator.com | 2023-04-09
that line of research is still going. https://github.com/lucidrains/block-recurrent-transformer-py... i think it is worth continuing research on both fronts.
A memory profiler for Python. As easy as adding a decorator!
Training neural networks in TensorFlow 2.0 with 5x less memory (by parasj)
Designed to constantly maintain the Proxmox cluster in balance
Implementation of Hierarchical Transformer Memory (HTM) for Pytorch
Asyncio cache framework for PythonProject mention: Python deserves a good in-memory cache library! | /r/Python | 2023-02-08
Also if you are looking for a good cache framework, maybe Cacheme can help you.
An always-on Anki review system.Project mention: Memory Hammer: An e-ink, always-on, OSS spaced repetition system | news.ycombinator.com | 2023-04-12
A heap dumper and analyzer for CPython based on GDBProject mention: Show HN: PyHeap – A heap dumper and analyzer for CPython based on GDB | news.ycombinator.com | 2022-12-12
:floppy_disk: Multi-platform library developed with ctypes for reading, writing and searching process memory, in a simple and friendly way with Python 3. The package supports Windows and Linux (32-bit and 64-bit).Project mention: Library for Memory Scanning for Python 3 (with a GUI application) | /r/Python | 2023-11-29
The code is on my GitHub->JeanExtreme002/PyMemoryEditor. I would also appreciate if you left a ⭐️ on the repository page if you like the project and want to see more updates!
A low-impact profiler to figure out how much memory each task in Dask is using
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
Python Memory related posts
Why is it using that much ram? Is that a trojan? Is that a feature of the linux-tkg kernel? (nothing else is running in the background)
1 project | /r/linuxmasterrace | 1 Jul 2023
Where is my RAM going?
2 projects | /r/Fedora | 28 May 2023
What is the appropriate uncompressed kernel ELF to use with dwarf2json? [ 5.19.0-42-generic #43~22.04.1-Ubuntu ], in order to create generate a custom symbols table to conduct linux memory forensics on Ubuntu 22.04?
2 projects | /r/computerforensics | 28 May 2023
Microservice memory profiling
2 projects | /r/FastAPI | 28 May 2023
Volatility 3 2.4.1 - New Linux and Windows plugins
1 project | /r/blueteamsec | 22 Apr 2023
ChatGPT like program that is trainable?
2 projects | /r/ChatGPT | 22 Apr 2023
PSA: the way the “free” command calculates unused memory changed significantly between Bullseye and Bookworm
1 project | /r/debian | 2 Apr 2023
A note from our sponsor - InfluxDB
www.influxdata.com | 8 Dec 2023
What are some of the best open-source Memory projects in Python? This list will help you: