You could do it that way. It allows control from one central location and no chance of customer mucking things up. With 4 pairs of speakers in each room it could be tough to power (assuming 8 ohm speakers) at 2 ohms per channel in a stereo configuration. I would get three inexpensive pre-amplifers or receivers with a pre-out main in capability (Harman Kardon HK3380) and three Behringer EP1500's at $299.00 each. This will allow sufficient power to each zone at 175 watts or so available to each speaker. You can use "Y" adapters to split the signal from the source components (CD, Mp3, XM radio, etc.) into each of the receivers. Not to mention you can also use each tuner in each of the receivers independently if you went the receiver route.
You could also look into a 4 zone multi-source system from Russound (CAS44K) or Niles or someone else. I believe you can get into them for around $1,499 retail msrp. I am sure you can find better deals there as well.
This allows you to have one set of source components, distribute them to 4 zones with a single multi channel amplifier, and control the source components from each room with the supplied kepads. The only thing that you may have to do is purchase more amplification. 4 pairs of speakers in each room is a lot. How big are the rooms? You may want to even look into some 70-volt systems in that case.
With the type of power capable in the scenario you outlined, you will need to run at a MINIMUM 14ga. speaker wire.