Thanks @mikeb. Trying to run this now and receiving the following:
building file list … rsync: link_stat “/Users/tylerkemp/?#200#234/Volumes/Data/Storage/InternalStorage?#200#235” failed: No such file or directory (2)
done
sent 29 bytes received 20 bytes 98.00 bytes/sec
total size is 0 speedup is 0.00
rsync error: some files could not be transferred (code 23) at /AppleInternal/Library/BuildRoots/a0876c02-1788-11ed-b9c4-96898e02b808/Library/Caches/com.apple.xbs/Sources/rsync/rsync/main.c(996) [sender=2.6.9]
The issue isn’t obvious to me. All file paths should be correct. Any insight?
building file list … file has vanished: “/Volumes/Data/Storage/InternalStorage/Lossless rips (.flac)/The Clash/The Story of the Clash, Vol. 1 [Epic E2K 44035 07464440352]”
done
rsync: symlink “/Users/tylerkemp/1/Untitled” → “/” failed: Read-only file system (30)
InternalStorage/
rsync: recv_generator: mkdir “/Users/tylerkemp/1/InternalStorage” failed: Read-only file system (30)
*** Skipping everything below this failed directory ***
sent 1361833 bytes received 26 bytes 8592.17 bytes/sec
total size is 451624661847 speedup is 331623.66
rsync warning: some files vanished before they could be transferred (code 24) at /AppleInternal/Library/BuildRoots/a0876c02-1788-11ed-b9c4-96898e02b808/Library/Caches/com.apple.xbs/Sources/rsync/rsync/main.c(996) [sender=2.6.9]
Tylers-MacBook-Pro:~ tylerkemp$
Getting a little further…it seems like now that “vanished” file has reared it’s ugly head again.
I can’t find the file to delete it as I stated earlier. No clue what to do there.
It also looks like my ROCK volume is read-only. Is this normal and is there a problem in changing the permissions?
Oh jeez…. I don’t know, it really shouldn’t be this complicated! You f you’re absolutely sure your path names are correct, perhaps your NuC really is dropping the connection? The rock volume obviously isn’t read only, but with rsync your only trying to read from it any way.
Looks suspicious, that’s a symlink from a directory under tylerkemp user home but it’s pointing to / which is your file system root. Do you mind sharing your full rsync command, this looks off a little.
This also looks like you’re trying to sync an area where files are been removed before rsync gets to them, possibly meaning that the command scope is wider than you intended. By that, I mean I doubt this is meant to be happening in your music library.
That’s the command I ran. The second part in question is because of that stupid vanished file. I can’t manually remove it to resolve the error because I can’t find it…
find / -type d -name "The Story of the Clash, Vol. 1 [Epic E2K 44035 07464440352]"
If you want to use spaces in your paths, or brackets for that matter, then do “quote” the paths to avoid your shell splitting the strings on spaces.
Edit when using rsync it’s often a good idea to test with a --dry-run switch at first to make sure that it does what you’re hoping it does before going with the full copy.
Ugh. Trying to find the file (while directory is changed to the ROCK) keeps giving permission denied errors, and running the command you pasted (on just one file to test) gives this error:
building file list … rsync: link_stat “/Users/tylerkemp/?#200#234/Volumes/Data/Storage/InternalStorage/Lossless rips (.flac)/AFI/All Hallow?#200#231s E.P [Nitro Records 15829-2 794171582921]/01 Fall Children.flac?#200#235” failed: No such file or directory (2)
done
sent 29 bytes received 20 bytes 98.00 bytes/sec
total size is 0 speedup is 0.00
rsync error: some files could not be transferred (code 23) at /AppleInternal/Library/BuildRoots/a0876c02-1788-11ed-b9c4-96898e02b808/Library/Caches/com.apple.xbs/Sources/rsync/rsync/main.c(996) [sender=2.6.9]
a few words about my backup strategy.
I have a main library of my music as FLAC files on an external USB drive (8TB) connected to my iMac. On this iMac, I use the software “Carbon Copy Cloner” (www.bombich.com) to copy the main library to my internal SSD-drive on my Roon-Core (Intel-NUC) over the Ethernet network.
Parallel I also make copies of my main library to another USB drive (14TB) connected to my iMac. And also on my QNAP NAS in the network.
When I buy new music, I put the FLAC files in my main library on the 4TB USB drive. Then I launch “Carbon Copy Cloner” and the software detects the new files and copies them to the SSD on the NUC, to the 14TB USB drive and to the QNAP NAS.
So I have the main library and three copies on different drives and enough safety for the musicfiles.
With greatings fom germany
I can’t speak from experience because I haven’t (yet) tried ROCK. But isn’t the internal storage pretty much a closed book, other than presenting it to ROON for playback? The OS is “just enough” for ROON, so it doesn’t necessarily expose the internal storage any other way. Nor is it necessarily visible to another OS on another computer (other than physically removing it and putting it in that computer).
Have you considered storing your library on an external or network drive? Then you could back it up any way you like.
That’s great, but you should keep at least keep one copy at a remote location, just in the remote case of a house fire. I keep a backup disk at my office. I never bring it home unless I replace it with another backup disk with newer content.
Hey Everybody,
I was able to do a sync finally; I’ll post the exact command I used since some people seemed curious as to how/if it would work. The last kink is the vanished folder which is still causing an rysnc error (that I’m ignoring for the time being). I deleted the album from Roon. I then created a new directory (“Clash new”) and moved all of the content from my original “The Clash” directory into it. My thinking was that if I fully delete the path to the vanished folder, the error can’t persist. The new directory syncs without error, but I CANNOT delete the original “The Clash” directory. I’ve tried doing this via Move to Trash and also with sudo elevated privileges via the command line, where I get a permission denied error. All permissions on this directory are set correctly. It seems to be some kind of Linux bug. I’m still not sure what caused the initial vanishing, but since I can’t delete the folder, my guess is that it’s in some sort of locked state, where rsync can’t see the contents accurately and keeps producing the error about a folder within that directory that no longer exists. Like I said, I think this is more a Linux bug than a ROCK bug, but any insight is welcome because I’m at a loss.
You’re welcome. I’ve been using it for a couple of years now, and while I haven’t had to use it to recover anything, it’s reassuring to know that the backup is there. The only thing to watch out for is that the initial sync can take quite a while, but once it’s done you’ll hardly notice you’re running it.
Thanks to everyone who chimed in on this. I ended up mounting the ROCK drive to a Windows OS and was immediately able to delete the directory I posted about earlier. I have no idea why but it seemed literally impossible from macOS. Deleting this folder resolved the error/warning in rsync as I had hoped it would. Below is the command that works for me, syncing only changes as well as deleting anything from the destination drive that is no longer resident on the source drive. I installed Homebrew and upgraded rsync as well, prior to success. This command will also produce a handy error log on the Desktop.
