I would use the RCA Y-adapter. You have it, it's not a bad way to go.
A multi-channel amp, designed for whole house audio is always best (IMO), because you select a single input on most amps to point your connection to. So, each speaker pair could get its own channel, then all the speaker pairs could point at a single input pair.