If we are talking about switching WIRES from one side to the other, it will sound incorrect as mentioned above. If you mean physically swapping right and left speakers (keeping left and right wire positions) then it would depend on the speakers and how they're oriented. Most will be fine in either position, some are designed as mirror image and will slightly alter the overall imaging of the front stage.