the easy way out would be to add another IM VC to the other set of speakers

that's what i would do ...
is there no 1x setting on the VC? you really don't need an IM VC unless your receiver doesn't have enough juice for a 4 ohm load
i think (wild guess) what's happening is that:
since the VC'ed speakers are now 16 ohms, they need less of the volume knob up ... still weird, but that's the best i can do