Backup Music Files - External Hard Disk - What Software with ExFat via Mac OSX

Hello,

I’m curious what other people are using (software) to backup their music files if their setup is ----> Roon Core with an external hard drive plugged into a NUC. I have my hard disk formatted as ExFat (per the recommendation) and I’m finding it complicated to backup because all of my machines are Mac OS and none of the software I normally use (Time Machine, SuperDuper) plays with ExFat. So I’m having to try and backup over the network and it keeps generating errors. Help!

I have been using GoodSync for more than 10 years, without any problems. Working on Windows though.

2 Likes

I treat the NUC’s storage as the primary one. I copy music files manually from my MacBook to the correct place in the folder structure of the NUC. The NUC storage is mounted by SMB on the MacBook.

The NUC storage gets backed up to the NAS by the backup software of the NAS

In contrast, my NUC has a copy of my primary library, which is contained on my laptop.

I use rsync to update the NUC, but most sync programmes should work fine. Whenever I edit file metadata I re-sync.

The laptop also synchronises with cloud storage, and is backed up daily to the cloud. I also backup to a removable hard drive every few days or so.

Although I no longer use a MacBook, I used this approach with macOS using the same tools: rsync (built-in), Backup Borg (Vorta), and Seafile.

rsync seems like it would be the most viable option and potentially easiest but I have no experience with Linux commands. would you be willing to explain what commands I would need to use if I’m copying from an HDD mounted on my NUC over the network to an HDD attached to my MacBook Pro? Is it scenario #5 as shown here: 16 Practical Examples of Rsync Command in Linux

I use this command, which connects to my non-ROCK core over SSH.

rsync -azP --delete ~/Music/Library/ martin@192.168.51.10:/srv/samba/music

However, for ROCK you first need to mount the SMB share:

mount -t smbfs //guest@rock.local/Data /<destination>

Change destination to a local folder on the Mac where you mount the share. Now, you can synchronise the files.

rsync -azP --delete ~/Music/Library/ /<destination>/<path-to-library>

Again, substitute destination with the correct path and append <path-to-library> so you have the full path to the folder containing your music library–you can browse the mounted share to identify this.

--archive, -a            archive mode is -rlptgoD (no -A,-X,-U,-N,-H)
--compress, -z           compress file data during the transfer
-P                       same as --partial --progress
--delete                 delete extraneous files from dest dirs

With a locally mounted SMB drive, you may as well omit the -z option.

how exactly do you achieve this?

The QNAP comes with the Hybrid Backup Sync software which can sync various sources over the network to the QNAP, sync or backup folders within the QNAP, and can also backup from the QNAP to various cloud backup services.

So I run a sync job in HBS that syncs the NUC’s storage via smb to a folder on the QNAP. Then I run two more jobs in HBS that create an incremental backup of this synced folder to two more folders on the QNAP, one daily and another one monthly.

Finally, when I find some time, I’ll create another backup job to back up to Backblaze.

The HBS software is quite nice. You can, e.g., schedule jobs by time but also make them dependent on each other. So my three jobs use dependencies, i.e., it first syncs the NUC and when this is finished runs first one and then the other backup.

1 Like

I’ve decided to use Rsync via Terminal. Seems to be working well.

1 Like

I’m in a similar config as yours: music on a USB drive (exfat format ) attached to my Nucleus and backup to my NAS.

I’m using Carbon copy cloner, that I was already using to backup my Mac.
Just had to create a new task to backup the music over Ethernet.
I added a reminder once a week to check if it was done.
The only flaw is that the Mac has to be awake to perform the task, not a big deal.

up til a few months ago i was using rsync, but i’ve hit on a cleaner and easier solution to keep multiple backups.

suppose i’ve downloaded X from qobuz or presto, or ripped it from a cd. on my mac i just drag and drop it into the roon music folder which resides on the core server (in my case, the Salk Streamplayer Series III) AND ALSO into whatever other drives i have connected to the mac.

i also use settings → backup to manually save metadata to the mac.

then backblaze to upload changes.

I follow @mjw , my primary library is on my desktop ,

Back up to 2 x 4Tb USB HDD

Synced to 4Tb SSD in NUC

I use Sync Back Pro for all syncs

@mjw when using rsync, can you specify what command to use if I only want to backup what’s new?

I have in post #7 above.

As you will have seen, there are a variety of good backup and sync solutions available. However, it’s worth considering your backup strategy in more detail, especially if you are used to the simplicity of Apple and Time Machine.

Many people recommend a minimum 3-2-1 backup strategy, with the first backup (2) being on-site, and the second (3) off-site. However, having experienced multiple drive failures and data losses over the years, I have adopted the following 4-3-2-1 approach (arguably OCD but it works):

  1. Primary storage - USB attached to ROCK
  2. Sync’d storage - USB attached to Mac Mini (I use Good Sync but there are lots of alternatives). The key point is that this is a simple mirror copy - if you delete some music by mistake, it will also be regularly deleted on the Sync version. This just protects you against total drive loss - important but limited. However the Sync stage is essential as it allows versioned on-site and off-site backups.
  3. Versioned on-site backup - I have the Mac Mini using Time Machine to backup to a separate disk, providing the standard hourly / daily / weekly / monthly backups, which allow me to recover any accidentally deleted music.
  4. Versioned off-site backup - I use BackBlaze (also widely used by the Roon Community). Works well, moderately priced and provides a rolling year’s worth of versioned backup.
    I test this setup roughly once a month - whenever I accidentally delete an album during library “housekeeping” and then later realise that I want it back!

@Gimlet i do have a Backblaze license but use it on a different machine. Is there documentation on how to setup on a NUC to backup both the Room database and associated HDD where music files live?

1 Like

@Gimlet for your scenario #2, are you syncing the MacMini over the network?

@Lance_Goler I am using the Backblaze license on my Mac Mini - once I have synced the music from the NUC onto the Mac Mini drive, I then upload to Backblaze from the Mac. As far as I know, it isn’t possible to have backup or sync software residing on a NUC running ROCK - hence my alternative approach described above.

@Lance_Goler Yes - I have set up the Mac to automatically mount the Exfat USB drive attached to my ROCK on startup. Assuming your Mac has already mapped the ROCK drive, the steps are

  1. System Preferences > Users & Groups
  2. From here, select Login Items and click + to add a new item
  3. Find your network drive and click Add, then close the window

This topic was automatically closed 45 days after the last reply. New replies are no longer allowed.