> Or at the very least add a second play button per song that actually plays the song.

Right click, Play Song Now. Not as discoverable as the play/queue button, but at least the option exists.

I think an animation of the item flying down to the queue would help emphasize that you're queuing a song, not playing it. But I don't know how easy that would be.