Well, there are a couple things at play here. First, if the amp can drive a 4 ohm load, then there is no problem. Just set the levels correctly.
Impedance ratings can be a little misleading. The impedance of a speaker varies with frequency. My PSBs have a max impedance of 16 ohms at ~1.5 kHz and a minimum of 4 ohms at around 150 Hz. PSB rates this speaker as having a "nominal" impedance of 6 ohms. It seems that different speaker companies have different ways of settling on this "nominal" impedance.....
Long story short, if you have a decent amp, this shouldn't be an issue. If you don't, there could be overheating issues or even shutting off at high volumes.