dmtcp

DMTCP: Distributed MultiThreaded CheckPointing (by dmtcp)

Dmtcp Alternatives

Similar projects and alternatives to dmtcp

NOTE: The number of mentions on this list indicates mentions on common posts plus user suggested alternatives. Hence, a higher number means a better dmtcp alternative or higher similarity.

dmtcp discussion

Log in or Post with

dmtcp reviews and mentions

Posts with mentions or reviews of dmtcp. We have used some of these posts to build our list of alternatives and similar projects. The last one was on 2024-06-21.
  • CRIU, a project to implement checkpoint/restore functionality for Linux
    12 projects | news.ycombinator.com | 21 Jun 2024
    We considered to use sth like this to cache some Python program state to speed up the startup time, as the startup time was quite long for some of our scripts (due to slow NFS, but also importing lots of libs, like PyTorch or TensorFlow). We wanted to store the program state right after importing the modules and loading some static stuff, before executing the actual script or doing other dynamic stuff. So updating the script is still possible while keeping the same state.

    Back then, CRIU turned out to not be an option for us. E.g. one of the problems was that it was not possible to be used as non-root (https://github.com/checkpoint-restore/criu/pull/1930). I see that this PR was merged now, so maybe this works now? Not sure if there are other issues.

    We also considered DMTCP (https://github.com/dmtcp/dmtcp/) as another alternative to CRIU, but that had other issues (I don't remember).

    The solution I ended up was to implement a fork server. Some server proc starts initially and only preloads the modules and maybe other things, and then waits. Once I want to execute some script, I can fork from the server and use this forked process right away. I used similar logic as in reptyr (https://github.com/nelhage/reptyr) to redirect the PTY. This worked quite well.

    https://github.com/albertz/python-preloaded

  • The intersection of shadow stacks and CRIU
    4 projects | news.ycombinator.com | 6 Jan 2023
    I would love to make more use of CRIU. E.g. I considered to use CRIU for my Python preloaded logic (https://github.com/albertz/python-preloaded). Unfortunately, at that point in time, CRIU must be used with root access, which was not an option. However, I see that the PR was merged now, so maybe it works now? (https://github.com/checkpoint-restore/criu/pull/1930)

    There is also DMTCP (https://github.com/dmtcp/dmtcp/) but this might have other problems for my use case.

    My solution was to use a fork server instead, which works almost equally well. There are not really much downsides with this approach. And this is actually quite simple, and also quite cross-platform (except Windows).

  • Python Preloaded
    4 projects | dev.to | 9 Oct 2022
    Or maybe DMTCP is a better alternative to CRIU?
  • Check point almost all your applications: dmtcp
    1 project | news.ycombinator.com | 10 Dec 2021
  • A note from our sponsor - InfluxDB
    www.influxdata.com | 17 Jul 2024
    Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality. Learn more →

Stats

Basic dmtcp repo stats
4
375
6.7
28 days ago

dmtcp/dmtcp is an open source project licensed under GNU General Public License v3.0 or later which is an OSI approved license.

The primary programming language of dmtcp is C++.


Sponsored
Power Real-Time Data Analytics at Scale
Get real-time insights from all types of time series data with InfluxDB. Ingest, query, and analyze billions of data points in real-time with unbounded cardinality.
www.influxdata.com

Did you konow that C++ is
the 6th most popular programming language
based on number of metions?