this post was submitted on 07 Sep 2023
44 points (95.8% liked)

Piracy: ꜱᴀɪʟ ᴛʜᴇ ʜɪɢʜ ꜱᴇᴀꜱ

54772 readers
403 users here now

⚓ Dedicated to the discussion of digital piracy, including ethical problems and legal advancements.

Rules • Full Version

1. Posts must be related to the discussion of digital piracy

2. Don't request invites, trade, sell, or self-promote

3. Don't request or link to specific pirated titles, including DMs

4. Don't submit low-quality posts, be entitled, or harass others



Loot, Pillage, & Plunder

📜 c/Piracy Wiki (Community Edition):


💰 Please help cover server costs.

Ko-Fi Liberapay
Ko-fi Liberapay

founded 1 year ago
MODERATORS
 

Hello, not so long ago I discovered Jellyfin, and by extension Radarr, Sonarr, Bazarr, Jackett, etc.

So I immediately installed Jellyfin on a Hetzner server that I already had, powerful enough to have several people consuming content at the same time on these kinds of services.

As the hard drives at home were full, and I didn't want to sacrifice my bandwidth, I got a Hetzner Storage Box to store the video content on.

So I've got Radarr, Sonarr and qBitTorrent installed on my computer, where I manage the downloads, upload them to the Storage Box which is then mounted on the server where Jellyfin is installed to serve the content (see the diagram above, the orange part would be a hypothesis for integrating more storage in the future).

Problems :

  • Synchronisation between my local machine and the Hetzner Storage Box: as I was saying, I download everything locally and then upload everything with rclone sync to the storage. The exact command is: rclone sync /mnt/2TB/Jellyfin HetznerBox:/Jellyfin --exclude "*.!qB" --transfers 10 --fast-list --checkers 500 --progress --log-level DEBUG --log-file=/var/log/rclone/rclone-sync-jellyfin.log This has several problems, it's slow, and I have a 1 GB/s fibre connection, and I doubt the problem is with Hetzner... Secondly, if I delete content on the storage server and run the command again, the content will be resynchronised. What's more, it often happens that I run the command and nothing happens for a long time before the synchronisation starts. Thirdly, rclone sync forces me to keep a local copy of everything.
  • rclone mount does not seem to respect the --vfs-cache-max-size: here is the command I use to mount the storage server on the server where Jellyfin is installed rclone mount HetznerBox:/Jellyfin /somepath/Jellyfin/ --vfs-cache-mode full --vfs-cache-max-size 100G --allow-other. But if I run df -h I get /dev/md2 436G 148G 266G 36% / And if I run sudo du -sh Jellyfin/ I get 378G Jellyfin/ The server only has Jellyfin installed, and I don't know how to look precisely how much the vfs cache is using.
  • since Radarr, Sonarr and everything are on my computer, if I install Jellyserr on the same server as Jellyfin (which would be perfect for managing everything when we have several users), it won't be able to communicate with Radarr and Sonarr.

Possible solutions:

  • Don't use my local machine. I'd like to use the Hetzner server for Radarr, Sonarr, qBitTorrent, etc. but the problem is that I don't want to store the data on this server, but on the Storage Box. How can I download directly from one server to another?
  • Could I use Mullvad VPN only for qBitTorrent downloads (and Jackett) on a Hetzner server, or is that too complicated or foolish?

Edit:

Diagram updated to adapt more to my configuration:

image

  • the Hetzner servers are in Finland
  • tried again overnight, rclone mount works fine, just extremely slow
  • downloads of "finished" torrents and those "in progress" are already separated
you are viewing a single comment's thread
view the rest of the comments
[–] newIdentity@sh.itjust.works 5 points 1 year ago* (last edited 1 year ago) (1 children)

I'm not really familiar with the Storage Box, but since you mount the storage box on the Hetzner server anyway, why not download directly to it?

Apparently it supports SMB so you could use SMB instead of rclone and mount the drive with fstab, but I don't know if it's faster

[–] retiolus@lemmy.cat 1 points 1 year ago (1 children)

I only heard that it was not advise / that it did not work well, and I actually tried it myself instead of using rclone sync to upload the content to the storage, mount it on my local machine. qBitTorrent downloaded everything, but the content was never reflected on the storage.

[–] newIdentity@sh.itjust.works 2 points 1 year ago

Another solution would be to set up a reverse proxy for your local network, but I don't know if it isn't a little overkill.