whitebox-tools
httm
Our great sponsors
whitebox-tools | httm | |
---|---|---|
13 | 98 | |
875 | 1,174 | |
- | - | |
6.3 | 9.9 | |
4 months ago | 8 days ago | |
Rust | Rust | |
MIT License | Mozilla Public License 2.0 |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
whitebox-tools
-
What other tools do you use to help you do GIS?
Whiteboxtools. Very fast and powerful. Works nice for hydrology and LiDAR. Good interface to Python as well.
-
What are GIS frameworks that promote the use of novel programming languages (Rust, Nim, Zig, ...)?
WhiteboxTools is written in Rust (with a Python API): https://github.com/jblindsay/whitebox-tools
-
White Box Tools - So Hot Right Now
Well..it's a white box, as opposed to Esri's black box..
-
What CLI tool will blow your mind? (written in rust)
WhiteboxTools (https://www.whiteboxgeo.com/) is a CLI tool that is about 500,000 lines of Rust (https://github.com/jblindsay/whitebox-tools) and is used for geospatial analysis in all kinds of industries. Most people use one of the many front-ends for it though (e.g. the QGIS plugin), so as to avoid the CLI, but at the most basic level, it's just a CLI. (Note, I'm the author of this tool, and so a little biased.)
-
WhiteboxTools v2.1 now released
We are pleased to announce the release of WhiteboxTools Open-Core v2.1 today. WhiteboxTools is an open-source platform for advanced geospatial analysis, and is used for GIS, remote sensing, lidar, hydrology, geomorphology, and many other data processing areas. This release includes new functionality and enhancements, including new tools for the calculation of various surface curvatures, multi-scale land surface parameter calculation, and the popular Geomorphons landform classification method. You may download the WhiteboxTools open-core here. Updated tool description files for the QGIS front-end, which include all of the new tools featured in this release, are available from here (see bottom of page). For more information about usage, please see the user manual.
-
ArcGIS Toolbox for WhiteboxTools v1.5.0 released w/ 468 tools for geospatial analysis
whitebox-tools: https://github.com/jblindsay/whitebox-tools
httm
-
Is my open-source project up to date with MIT license compliance and attribution?
My projects and many projects include a THIRD-PARTY-LICENSES.html file when I distribute binaries. See: https://github.com/kimono-koans/httm/blob/master/third_party/LICENSES_THIRD_PARTY.html
-
ZFS silent corruption bug found: replaces chunks inside copied files by zeroes
> It's worth noting that copy_file_range is used by a lot of things.
Yes, but the trigger feature, block cloning, only landed in the latest 2.2 release. If you immediately hopped on 2.2, and used a system with lots copy_file_range and FICLONE use, yes, you may have a problem (like, as you note, on Gentoo, where this problem surfaced).
Most people were just hopping on the bandwagon. My distro ships 2.1.5, so I have a 6 month wait until this feature lands, so I was just building copy_file_range support into my ZFS apps, right before news of this bug hit.[0]
> There are other things required to trigger the bug that are a lot less common though.
Exactly. My guess is the incidence of this will exceedingly rare for the common user/small NAS user/etc. I've run a corruption detector[0], and what I've found mostly indicates false positives. Some are build artifact fingerprints, which I don't care about, and which were deleted with the next build. The ones with an extant file on another system, I confirmed were a diff match with the origin using `rsync -rincv` and whats on snapshots with `httm --map-aliases`. So far no positive matches.
-
Are you running Linux with a filesystem capable of block cloning/FICLONE (ZFS >= 2.2, XFS, BTRFS)?
cargo install --git https://github.com/kimono-koans/httm --branch clones strace -f -o stderr.txt -e ioctl -- httm -r -R ~/.zshenv
- ZFS for Dummies
-
Really no easy GUI Btrfs snapshots for Fedora 38?
All btrfs snapshot tools can have different layouts. It's mostly a nightmare for any one tool to support. Although its not the tool you're looking for, FYI AFAIK httm supports all/most btrfs layouts, but it took more work than necessary to get there.
-
Bcachefs – A New COW Filesystem
Really excited about this.
Once support hits in Linux, a little app of mine[0] will support block cloning for its "roll forward" operation, where all previous snapshots are preserved, but a particular snapshot is rolled forward to the live dataset. Right now, data is simply diff copied in chunks. When this support hits, there will be no need to copy. Previous snapshot blocks can just be used as refs.
ZFS only option which requires super user privileges.
[0]: https://github.com/kimono-koans/httm/blob/master/httm.1
-
What's a really niche tool you use that you can't live without?
httm - Interactive, file-level Time Machine-like tool for ZFS/btrfs/nilfs2
-
Backup Solution With Details About Deleted Files
this seems like a good use case for httm https://github.com/kimono-koans/httm
What are some alternatives?
whitebox-python - WhiteboxTools Python Frontend
fzf-fish-integration - 🔍🐟 Fzf plugin for Fish
dotfiles - My dotfiles
zfsbootmenu - ZFS Bootloader for root-on-ZFS systems with support for snapshots and native full disk encryption
reflex - Run a command when files change
nim-gdal - Nim wrapper for Geospatial Data Abstraction Library (GDAL)
zfs - OpenZFS on Linux and FreeBSD
awesome-rust - A curated list of Rust code and resources.
WhiteboxTools-ArcGIS - ArcGIS Python Toolbox for WhiteboxTools
fzf - :cherry_blossom: A command-line fuzzy finder
skim - Fuzzy Finder in rust!
gitoxide - An idiomatic, lean, fast & safe pure Rust implementation of Git