Torrents manage this without any extra tech. Just grab the .torrent file, and only select the files you have space for. Download them then seed, and get your 150 friends to do different files. If I then go to download a file that’s in your batch, the download will happen from your server (and whoever else is seeding these files), and if I go to download a file that’s on one of your 150 others’ server it’ll download from there.
Yes, almost. But i want it to seem like i have all 400tb on my 3tb drive. I want the cache to handle downloads automatically and I want an even spread of files so that none get lost.
A very long time ago I remember there being FUSE filesystems that allow you to mount a .torrent like a network drive. I have no idea if these are still kicking though. Still doesn’t provide all of your extra bullet points but might be a good start to the rabbit hole
I have 3gb of space to share. Are there 150 other people like me that want to do some distributed hosting? What technology can handle this?
Torrents manage this without any extra tech. Just grab the .torrent file, and only select the files you have space for. Download them then seed, and get your 150 friends to do different files. If I then go to download a file that’s in your batch, the download will happen from your server (and whoever else is seeding these files), and if I go to download a file that’s on one of your 150 others’ server it’ll download from there.
Yes, almost. But i want it to seem like i have all 400tb on my 3tb drive. I want the cache to handle downloads automatically and I want an even spread of files so that none get lost.
Torrents give me:
But they do not give me:
Guarantees that every file stays availableA way to say “this file must exist on N peers”Maybe I should be typing this into a LLM.
Edit: ChatGPT is suggesting an IPFS Cluster
Edit 2: If the torrents stays active I can remove some requirements
Ahh fair enough! Yeah, not sure about all that.
A very long time ago I remember there being FUSE filesystems that allow you to mount a .torrent like a network drive. I have no idea if these are still kicking though. Still doesn’t provide all of your extra bullet points but might be a good start to the rabbit hole
Fuse looks like a good way to make the 3tb look like 400tb but it doesn’t do the replication bit.
I’m commenting these ideas publicly because maybe others will join in. Thanks for playing along!