I was able to find this forum post that listed ports 8008 and 8009 needing to be open for chromecast to work. I am running server 2016 so I think this is more of a windows server thing than it is VM since Windows server is more locked down by default. Once I opened these up on the windows firewall chromecast started working.