httpdirfs
direct-io
Our great sponsors
httpdirfs | direct-io | |
---|---|---|
8 | 1 | |
714 | 65 | |
- | - | |
6.5 | 0.0 | |
1 day ago | about 1 year ago | |
C | C | |
GNU General Public License v3.0 or later | MIT License |
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
httpdirfs
-
Mount virtual http[s] iso command for progressive adaptive random access download with optional resumable download going to storage?
That said.. I'm pretty sure https://github.com/fangfufu/httpdirfs will do approximately what you're asking for.
-
How to browse a http archive from terminal?
Maybe something like this?
-
Use HTTP Remote with single file link
Then tried httpdirfs https://github.com/fangfufu/httpdirfs
-
I implemented the "Single File Mode" in HTTPDirFS, so you can now mount any arbitrary file served by a HTTP server in a virtual directory.
Basically this new feature behaves in the same way as the old httpfs. Somebody requested this feature.
-
But How, Do Databases Use Mmap?
You are correct, this works. There even is a file system built around this: https://github.com/fangfufu/httpdirfs
direct-io
-
But How, Do Databases Use Mmap?
I wrote this for Node.js, which is a native binding in C, exposing cross platform functionality: https://github.com/ronomon/direct-io
Although if it's a new project and you're used to C, I would recommend also taking a good look at Zig (https://ziglang.org/), because it's so explicit about alignment compared to C, and makes alignment a first-class part of the type system, see this other comment of mine that goes into more detail: https://news.ycombinator.com/item?id=25801542
Something that will also help, is setting your minimum IO unit to 4096 bytes, the Advanced Format sector size, because then your Direct IO system will just work, regardless of whether sysadmins swap disks of different sector sizes from underneath you. For example, a minimum sector size of 4096 bytes will work not only for newer AF disks but also for any 512 byte sector disks.
Lastly, Direct IO is actually more a property of the file system, not necessarily the OS (e.g. Linux), so you will some file systems on Linux that return EINVAL when you try to open a file descriptor with O_DIRECT, simply because they don't support O_DIRECT (e.g. a macOS volume accessed from within a Linux VM) so that should be your way of testing for support, not only the OS.
What are some alternatives?
wsl2-debian - Debian for WSL2.
imdb-rename - A command line tool to rename media files based on titles from IMDb.
pcloud-console-client - A simple console client for pCloud cloud storage.
project-safe-transmute - Project group working on the "safe transmute" feature
wg-allocators - Home of the Allocators working group: Paving a path for a standard set of allocator traits to be used in collections!
rvault - rvault: secure and authenticated store for secrets and small documents
hh-suite - Remote protein homology detection suite.
libuv - Cross-platform asynchronous I/O
libcurl - A command line tool and library for transferring data with URL syntax, supporting DICT, FILE, FTP, FTPS, GOPHER, GOPHERS, HTTP, HTTPS, IMAP, IMAPS, LDAP, LDAPS, MQTT, POP3, POP3S, RTMP, RTMPS, RTSP, SCP, SFTP, SMB, SMBS, SMTP, SMTPS, TELNET, TFTP, WS and WSS. libcurl offers a myriad of powerful features
MMseqs2 - MMseqs2: ultra fast and sensitive search and clustering suite