All that means is you are using less than 40w to drive the speakers... Just because an amp puts out 100w doesn't mean the speaker is actually using 100w; and unless you have the receiver/amp turned up to 100% gain, it isn't outputting it's rated power. Sorry, that's not a theory...
I've driven a little 4" mid with a bridged amp putting out 475w x 1 with no crossover and it didn't fry either. I believe the key there was the fact that I used no crossover, because it is often the crossover that has at least one component that is rated only for a certain wattage. Too much power is rarely an issue also, because an unclipped signal, even at the speaker's rated max, will usually not cause a problem. Not having enough power to keep the signal from clipping is when things really start to go wrong.