Indeed, both Compositions (on an Artist page) and Discography rely on the integration with a streaming service. They are not driven by the local library content or displayed unless you are using a streaming service.
The Compositions browser is different - that is driven by the content of your library alone (whether local or including items from streaming services).