fdupes
ipfs
Stars - the number of stars that a project has on GitHub. Growth - month over month growth in stars.
Activity is a relative number indicating how actively a project is being developed. Recent commits have higher weight than older ones.
For example, an activity of 9.0 indicates that a project is amongst the top 10% of the most actively developed projects that we are tracking.
fdupes
- Fdupes: Identify or Delete Duplicate Files
- fdupes: Identify or Delete Duplicate Files
-
Removing image duplicates
fdupes is simple and easy to use: https://github.com/adrianlopezroche/fdupes
- Backing Up Data: Tips/Advice for Tons of Unorganized Data and Duplicate Files from Multiple Sources
-
File Deduplication
I recently used [fdupes](https://github.com/adrianlopezroche/fdupes) to figure out duplicate files from my amazon cloud drive / photos migration. Took about 2 days to scour through about 1.5TB worth of day.
-
How would I go about copying around 5TB worth of data, from multiple drives to a singular drive/drives (Shared Pools/Raid)?
I would add the content of your current drives with rysnc to the new big drive. I would then run https://github.com/adrianlopezroche/fdupes To remove duplicate files.
- Ask HN: Tool to find identical file subtrees scattered over disks
-
Which tool do you use to find duplicate files?
jdupes, an optimized fork of the popular fdupes. There's 32-bit and 64-bit Win32 packages of jdupes there on Github.
- Mercredi Tech - 2022-05-11
- Suggestions on how to identify & report on old stale data in file shares?
ipfs
-
Filecoin Foundation Successfully Deploys IPFS in Space
> CDNs
If you think IPFS is trying to "re-spin CDNs as their invention", I'm pretty sure you misunderstand what IPFS. The homepage is a great starting point if you're curious rather than antagonistic: https://ipfs.tech/
> IPFS doesn't solve persistence of data
I don't think it claims to solve this either? What it does claim to solve is the persistence of identifiers of data.
> doesn't solve churn in p2p systems
What P2P system has ever done so or even claimed to have done so?
- Ask HN: Do we have a protocol for interplanetary internet?
- Create bug Microsoft Windows98 to help me get the job and the other
-
Build an AI-powered NFT generator with TS, GPT, Polygon and CASE (Part 1/2)
We will create a web app that will let users mint a NFT in one click: creating an AI art from a prompt, storing it on IPFS and mint the unique NFT in Polygon so you can see it on OpenSea. Pretty cool right ?
-
Building Trust in a Trustless World: Decentralized Applications Unveiled
IPFS, which stands for Inter-Planetary File System, is a decentralized storage system where files are distributed among peers in a peer-to-peer (P2P) network. It operates on a "content addressable" model, meaning that each file is given a unique hash that serves as its identifier. By using this hash, you can retrieve any file from any IPFS node in the network.
-
rarbg archive removed from GitHub due to DMCA
Like this? https://ipfs.tech/
-
Mirrors or alternatives to e621 on the decentralized / distributed web
Was thinking of something and figured it would be a good opportunity to ask here. With the censorship madness going on in the world and furry community included, I often worry if even places like e621 can remain free and open in the face of increasing pressure by increasingly angry and authoritarian crowds. For both this and other geek reasons I've been interested in decentralized internet technology for a long time, following projects like IFPS which I just love as a concept.
-
How would you exchange information between places thousands of light years apart? How would "internet" work at such distances?
Using the Interplanetary File System, a real thing that exists today, designed for this purpose.
-
Alternative to Youtube Vimeo
I post a lot about IPFS, I was using the 'ipfs mount' to virtually offer my entire collection from my NAS (on a private 'swarm' of course) to the remote stations.
- Vous avez un avatar hexagonal sur reddit ? Félicitations, c'est un NFT. Vous ne le saviez pas ? C'est normal, reddit évite soigneusement d'utiliser ce terme, réussissant ainsi à vendre des NFT à ses utilisateurs largement anti-crypto.
What are some alternatives?
rdfind - find duplicate files utility
arweave - The Arweave server and App Developer Toolkit.
jdupes - A powerful duplicate file finder and an enhanced fork of 'fdupes'.
ZeroNet - ZeroNet - Decentralized websites using Bitcoin crypto and BitTorrent network
rmlint - Extremely fast tool to remove duplicates and other lint from your filesystem
orbitdb - Peer-to-Peer Databases for the Decentralized Web
czkawka - Multi functional app to find duplicates, empty folders, similar images etc.
nostr - a truly censorship-resistant alternative to Twitter that has a chance of working
go-find-duplicates - Find duplicate files (photos, videos, music, documents) on your computer, portable hard drives etc.
skynet-webportal - A webapp that makes Skynet accessible to web browsers.
dupeguru - Find duplicate files
graph-node - Graph Node indexes data from blockchains such as Ethereum and serves it over GraphQL