That's where the common sense part comes in

Sure, you can send too much current to a speaker, but that isn't likely to happen in normal listening IMO. I have hooked up very high power amps to some crappy little speakers and even when
intentionally trying to damage them I found it was more difficult than I thought, however my brother managed to blow one of the speakers in my car in a few minutes by cranking it.