httpdirfs
imdb-rename
Our great sponsors
| httpdirfs | imdb-rename | |
|---|---|---|
| 8 | 6 | |
| 714 | 221 | |
| - | - | |
| 6.5 | 6.2 | |
| 2 days ago | about 2 months ago | |
| C | Rust | |
| GNU General Public License v3.0 or later | The Unlicense |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
httpdirfs
-
Mount virtual http[s] iso command for progressive adaptive random access download with optional resumable download going to storage?
That said.. I'm pretty sure https://github.com/fangfufu/httpdirfs will do approximately what you're asking for.
-
How to browse a http archive from terminal?
Maybe something like this?
-
Use HTTP Remote with single file link
Then tried httpdirfs https://github.com/fangfufu/httpdirfs
-
I implemented the "Single File Mode" in HTTPDirFS, so you can now mount any arbitrary file served by a HTTP server in a virtual directory.
Basically this new feature behaves in the same way as the old httpfs. Somebody requested this feature.
-
But How, Do Databases Use Mmap?
You are correct, this works. There even is a file system built around this: https://github.com/fangfufu/httpdirfs
imdb-rename
- IMDB-rename: A command line tool to rename media files based on titles from IMDB
-
my rarbg magnet backup (268k)
I wrote a tool that did something related a while back using IMDb data: https://github.com/BurntSushi/imdb-rename
-
Projects in rust
This might be of interest: https://github.com/BurntSushi/imdb-rename
-
The technology behind GitHub’s new code search
What a shit take. The article itself is perhaps a nice light overview of 101-ish level concepts, although knowing how and when to apply them in a real engineering context is not something I would consider 101 level. And certainly, building something that is actually at the scale of GitHub Search is nowhere near 101 level.
This is what a 101-level inverted index implementation looks like: https://github.com/BurntSushi/imdb-rename
In other words, absolutely nothing like what GitHub built. Nowhere close.
-
How to use mmap safely in Rust?
imdb-rename is an example of a tool that memory maps FSTs on disk in order to execute fulltext searches very quickly on the command line.
-
But How, Do Databases Use Mmap?
> How else would you lazy-load a database of (say) 32GB into memory, almost instantly?
That's what the fst crate[1] does. It's likely working at a lower level of abstraction than you intend. But the point is that it works, is portable and doesn't require any cooperation from the OS other than the ability to memory map files. My imdb-rename tool[2] uses this technique to build an on-disk database for instantaneous searching. And then there is the regex-automata crate[3] that permits deserializing a regex instantaneously from any kind of slice of bytes.[4]
I think you should maybe provide some examples of what you're suggesting to make it more concrete.
[1] - https://crates.io/crates/fst
[2] - https://github.com/BurntSushi/imdb-rename
[3] - https://crates.io/crates/regex-automata
[4] - https://docs.rs/regex-automata/0.1.9/regex_automata/#example...
What are some alternatives?
direct-io - Direct IO helpers for block devices and regular files on FreeBSD, Linux, macOS and Windows.
wsl2-debian - Debian for WSL2.
wg-allocators - Home of the Allocators working group: Paving a path for a standard set of allocator traits to be used in collections!
pcloud-console-client - A simple console client for pCloud cloud storage.
stack-graphs - Rust implementation of stack graphs
rvault - rvault: secure and authenticated store for secrets and small documents
lsif-clang - Language Server Indexing Format (LSIF) generator for C, C++ and Objective C
textscanner
libcurl - A command line tool and library for transferring data with URL syntax, supporting DICT, FILE, FTP, FTPS, GOPHER, GOPHERS, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS, MQTT, POP3, POP3S, RTMP, RTMPS, RTSP, SCP, SFTP, SMB, SMBS, SMTP, SMTPS, TELNET, TFTP, WS and WSS. libcurl offers a myriad of powerful features
spack-batteries-included - Installing spack without system dependencies