“B” speakers are typically in another room, so there’s no reason it would hurt, as long as your amplifier can handle a 4-ohm load.
However, if you're setting up both in the same room and plan to run them both at the same time, that typically does not get good results, no matter what the secondary speakers are.
Regards,
Wayne A. Pflughaupt