bazel-buildfarm
pyroscope-rs
Our great sponsors
bazel-buildfarm | pyroscope-rs | |
---|---|---|
4 | 6 | |
624 | 129 | |
4.5% | 7.8% | |
9.5 | 7.1 | |
5 days ago | 7 days ago | |
Java | Rust | |
Apache License 2.0 | Apache License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
bazel-buildfarm
-
Distcc: A fast, free distributed C/C++ compiler
It can be. By default it is local.
But it has protobufs interfaces (IIRC), so a distributed build farm would generate the grpc endpoints for their implementation and then you tell bazel on the command line (or via .bazelrc) the address of the build farm it can use.
There's a couple of projects that implement the distributed/grpc part, the main one is https://github.com/bazelbuild/bazel-buildfarm
-
Rust Is Portable
Not sure what to say concerning buildfarm's remote execution.
Reading an issue I've opened 1y ago [1], seems the backend requires the client to have a specific gcc version.
That's a strong limitation imho.
[1] https://github.com/bazelbuild/bazel-buildfarm/issues/545
-
Running container_push inside a container
You can also set up a remote build service that uses the same environment you run the containers in using something like https://github.com/bazelbuild/bazel-buildfarm
-
Distributed build clusters
Currently migrating to Bazel + bazel remote execution via Bazel buildfarm. Bazel has native support for build clusters.
pyroscope-rs
- Show HN: Pyroscope-rs, a multi-language profiler built with Rust
-
Ask HN: What Are You Working On? (August 2022)
A general purpose profiler: https://github.com/pyroscope-io/pyroscope-rs
If someone is interested in this space, feel free to reach me!
-
Rust Is Portable
I feel some of the OP points. I was working on a profiling agent lately, and one of the issues was running it on multiple platforms (just the four big ones linux/mac-x86/arm) on FFI (because it'll be run directly from python/ruby/etc...) and preferably having the thing just work without having to install or configure any dependencies.
Like OP I hit two walls: libunwind, and linking. For libunwind, I ended up downloading/compiling manually; and for linking there is auditwheel[1]. Although it is a Python tool, I did actually end up using for Ruby (by creating a "fake python package", and then copying the linked dependencies).
It was at that time that I learned about linking for dynamic libraries, patchelf and there is really no single/established tool to do this. I thought there should be something but most people seem to install the dependencies with any certain software. I also found, the hard way, that you still have to deal with gcc/c when working with Rust. It does isolate you from many stuff, but for many things there is no work around.
There is a performance hit to this strategy, however, since shared dynamic libraries will be used by all the running programs that need them; whereas my solution will run its own instance. It made me wonder if wasm will come up with something similar without affecting portability.
Finally, the project is open source and you can browse the code here: https://github.com/pyroscope-io/pyroscope-rs
[1]: https://github.com/pypa/auditwheel
-
Pyroscope Profiler 0.5 released
Version 0.5 is now live!: https://github.com/pyroscope-io/pyroscope-rs
-
What's everyone working on this week (17/2022)?
Working on https://github.com/pyroscope-io/pyroscope-rs A profiling solution for Rust and other languages.
-
Rust support for continuous profiling added in Pyroscope v0.10.2
Thanks to the maintainers at pprof-rs for helping us figure out how we can modify their profiler to create our rust agent (https://github.com/pyroscope-io/pyroscope-rs).
What are some alternatives?
llama
pprof-rs - A Rust CPU profiler implemented with the help of backtrace-rs
gnu-parallel - A clone of GNU Parallel (git://git.savannah.gnu.org/parallel.git)
weaver - API tool,but egui style and rusty
mainframer - Tool for remote builds. Sync project to remote machine, execute command, sync back.
trippy - A network diagnostic tool
sccache - Sccache is a ccache-like tool. It is used as a compiler wrapper and avoids compilation when possible. Sccache has the capability to utilize caching in remote storage environments, including various cloud storage options, or alternatively, in local storage.
oxide - Teach your PostgreSQL database how to speak MongoDB Wire Protocol
rules_closure - Closure rules for Bazel
reframe - LeapTable 🦘- The fastest way to build, deploy, and manage LLM-powered agents on tabular data (dataframes, SQL tables and Spreadsheets). [Moved to: https://github.com/peterwnjenga/leaptable]
pyzmq - PyZMQ: Python bindings for zeromq
DIIS-rs - Minimal Rust library for the Direct Inversion in the Iterative Subspace (DIIS) algorithm and its variants