Your speakers will be fine, Also, Dont set your reciever on 4 ohm setting. Leave it on 8 ohms, This is used by manufactuers to sort of cheat their way into making an amp 4 ohm stable by limiting its current. Its meant to keep the amp from overheating driving 4 ohm speakers and so when you turn it on your power is limited and therefore it wont get as hot.
Think of it like taking a huge engine and sticking it in a car that cant handle the power. Instead of letting the engine produce its full power and possibly blow drivetrain up they have limited the power so it wont. Only, You likely wont blow your reciever up. Worst case scenario is that it will overheat and shut itself off until its cooled down.
Look for speaker selectors that are impedance matching which means you can hook lots of speakers up and still be ok with not having too low of an impedance.