Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge. Learn more →
Top 20 Python Memory Projects
-
second time was nastier. I used https://github.com/bloomberg/memray to try to spot it - that's the tool you should try out. You load your service through memray, and it will get you some stats that you can export as a flamegraph. I can't really afford to make it run on production so I ran it in a docker image and repeatedly ran the scenario I thought was responsible. Didn't find anything. I know what I did wrong: I assumed one particular codepath was the problem. If would have find the issue if I had a really complete scenario that covers broadly every possible endpoint and condition. Can't blame memray, that tool is really promising.
-
Project mention: Single Window Mode when Firefox is already launched with -profile "my_profile" parameter | /r/firefox | 2023-04-20
fyi: python + https://github.com/giampaolo/psutil is pretty portable
-
InfluxDB
Collect and Analyze Billions of Data Points in Real Time. Manage all types of time series data in a single, purpose-built database. Run at any scale in any environment in the cloud, on-premises, or at the edge.
-
Project mention: What is the appropriate uncompressed kernel ELF to use with dwarf2json? [ 5.19.0-42-generic #43~22.04.1-Ubuntu ], in order to create generate a custom symbols table to conduct linux memory forensics on Ubuntu 22.04? | /r/computerforensics | 2023-05-28
I need this to create generate a custom symbols table (using dwarf2json), in order to run a memory dump acquired by Ubuntu 22.04, as Ubuntu 22.04 kernel does not work anymore with volatility 2 (Issue here: volatilityfoundation/volatility#828)
-
-
Project mention: Update 4: RedReader granted non-commercial accessibility exemption | /r/RedReader | 2023-06-09
Promnesia & theconversation.social were on similar themes/solutions.
-
Project mention: Why is it using that much ram? Is that a trojan? Is that a feature of the linux-tkg kernel? (nothing else is running in the background) | /r/linuxmasterrace | 2023-07-01
I use a script I call memtop10.sh that uses a combination of ps and ps_mem.py which you can find here: https://github.com/pixelb/ps_mem/blob/master/ps_mem.py
-
memorizing-transformers-pytorch
Implementation of Memorizing Transformers (ICLR 2022), attention net augmented with indexing and retrieval of memories using approximate nearest neighbors, in Pytorch
Project mention: A single API call using almost the whole 32k context window costs around 2$. | /r/OpenAI | 2023-03-15There is a GitHub repo https://github.com/lucidrains/memorizing-transformers-pytorch the implementation deviates from the paper slightly, using a hybrid attention across attention logits local and distant (rather than the sigmoid gate setup). It also uses cosine similarity attention (with learned temperature) for the KNN attention layer. There are also some features that are not mentioned in the paper, such as Transformer-XL memories and shifting memories down. There are no easy-to-use Memorizing Transformers implementations yet.
-
Onboard AI
Learn any GitHub repo in 59 seconds. Onboard AI learns any GitHub repo in minutes and lets you chat with it to locate functionality, understand different parts, and generate new code. Use it for free at www.getonboard.dev.
-
-
recurrent-memory-transformer-pytorch
Implementation of Recurrent Memory Transformer, Neurips 2022 paper, in Pytorch
Of course, lucidrains already has an empty repo up. So that's worth keeping an eye on.
-
gpt-voice-conversation-chatbot
Allows you to have an engaging and safely emotive spoken / CLI conversation with the AI ChatGPT / GPT-4 while giving you the option to let it remember things discussed.
-
that line of research is still going. https://github.com/lucidrains/block-recurrent-transformer-py... i think it is worth continuing research on both fronts.
-
-
-
-
-
Also if you are looking for a good cache framework, maybe Cacheme can help you.
-
Project mention: Memory Hammer: An e-ink, always-on, OSS spaced repetition system | news.ycombinator.com | 2023-04-12
-
Project mention: Show HN: PyHeap – A heap dumper and analyzer for CPython based on GDB | news.ycombinator.com | 2022-12-12
-
PyMemoryEditor
:floppy_disk: Multi-platform library developed with ctypes for reading, writing and searching process memory, in a simple and friendly way with Python 3. The package supports Windows and Linux (32-bit and 64-bit).
Project mention: Library for Memory Scanning for Python 3 (with a GUI application) | /r/Python | 2023-11-29The code is on my GitHub->JeanExtreme002/PyMemoryEditor. I would also appreciate if you left a ⭐️ on the repository page if you like the project and want to see more updates!
-
-
SaaSHub
SaaSHub - Software Alternatives and Reviews. SaaSHub helps you find the best software and product alternatives
NOTE:
The open source projects on this list are ordered by number of github stars.
The number of mentions indicates repo mentiontions in the last 12 Months or
since we started tracking (Dec 2020).
The latest post mention was on 2023-11-29.
Python Memory related posts
- Why is it using that much ram? Is that a trojan? Is that a feature of the linux-tkg kernel? (nothing else is running in the background)
- Where is my RAM going?
- What is the appropriate uncompressed kernel ELF to use with dwarf2json? [ 5.19.0-42-generic #43~22.04.1-Ubuntu ], in order to create generate a custom symbols table to conduct linux memory forensics on Ubuntu 22.04?
- Microservice memory profiling
- Volatility 3 2.4.1 - New Linux and Windows plugins
- ChatGPT like program that is trainable?
- PSA: the way the “free” command calculates unused memory changed significantly between Bullseye and Bookworm
-
A note from our sponsor - InfluxDB
www.influxdata.com | 8 Dec 2023
Index
What are some of the best open-source Memory projects in Python? This list will help you:
| Project | Stars | |
|---|---|---|
| 1 | memray | 11,503 |
| 2 | psutil | 9,677 |
| 3 | volatility | 6,636 |
| 4 | volatility3 | 1,907 |
| 5 | promnesia | 1,630 |
| 6 | ps_mem | 1,454 |
| 7 | memorizing-transformers-pytorch | 591 |
| 8 | MalConfScan | 460 |
| 9 | recurrent-memory-transformer-pytorch | 356 |
| 10 | gpt-voice-conversation-chatbot | 248 |
| 11 | block-recurrent-transformer-pytorch | 185 |
| 12 | memprof | 127 |
| 13 | checkmate | 119 |
| 14 | Proxmox-load-balancer | 116 |
| 15 | HTM-pytorch | 69 |
| 16 | cacheme | 36 |
| 17 | memory-hammer | 29 |
| 18 | pyheap | 28 |
| 19 | PyMemoryEditor | 26 |
| 20 | dask-memusage | 24 |
SaaSHub - Software Alternatives and Reviews
SaaSHub helps you find the best software and product alternatives
www.saashub.com