Nice! I tried but I must be missing something. Is it a setting? Only way I can see to join voice is to click on the channel and then click the voice button?

You can create an invite link to a voice channel instead. There's even a wiki how to this https://www.wikihow.com/Invite-People-to-a-Discord-Channel-o...