How do I export a list of albums to Excel?

There’s a menu option to “Select All” (look at the last part of this FAQ). Also, the behaviour of the Track and Album browsers is the same as the Windows File Explorer - that is, you can use Shift-click to define ranges, Ctrl-A will select All items, or Ctrl-Click will toggle selection of a single item.