this post was submitted on 06 Aug 2023
1457 points (98.9% liked)
Announcements
23222 readers
4 users here now
Official announcements from the Lemmy project. Subscribe to this community or add it to your RSS reader in order to be notified about new releases and important updates.
You can also find major news on join-lemmy.org
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
One of the biggest burdens on people running lemmy servers, is the disk space taken up by images. Currently the internet has a massive problem with image (and other data in general) duplication: images get posted to 9 different platforms, copied everywhere, with none of them sharing any of the hosting costs.
The static data distribution problem, is actually a completely solved problem: via torrents. The user experience of this tho, needs to be improved across the board in apps and web UIs. Lemmy's markdown fields do support torrent links, but there's no easy "upload audio" or "upload video" button, which ideally should hook in to an in-browser or system-wide torrent app.
I'd love to see comment trees of audio and video replies, but to me this isn't doable, and would explode server costs, unless someone devotes time to the solution above. In the meantime, people will just have to use other services to upload their audio / video content and link to it, or ideally, create torrents and share magnet links.
This is interesting, I've never considered torrents for this exact case before. Has anyone done any groundwork to figure out what this would look like from a systems level? I'm having a hard time wrapping my head around the big picture - where the seeders come from, what are the incentives to keep certain kinds of data resilient, how to keep complexity away from the clients, etc.
This issue isn't specific to lemmy, but to the entire web, which has a serious duplicated static data problem. Webtorrents started to tackle these problems, but didn't get too far IMO because the vast majority of torrent seeders use native clients.
Essentially, people need to normalize seeding / posting torrent magnet links, and create platforms built around them. And web and app UIs need ways to view that data in a seamless way.
If I had a lot more time I'd wanna work on it, but my backlog is years long.
There may be an opportunity here for Lemmy to help solve part of the distributed blob problem, that is, what are the incentives for people to contribute bandwidth/storage? Instead of the dodgy crypto-reward schemes we see come up, it could just be an extension to the motivations already driving why people set up Lemmy instances or contribute hours to moderate communities.
Some brain-droppings: