Speaker B is meant for stereo in another room - kind of a cheap zone2. Note that the center and surrounds won't work with only speaker B engaged either. I don't think that's unique to Yamaha, my Onkyo works the same way.
I think the only thing you could do would be to use Speaker A to a speaker selector and wire both sets of speakers to the selector.