Class D amplifiers have worked so well that exactly 3 mass-market receivers, the exact products who stand the most to benefit from their lighter weight and smaller size, have used them.
All three were SO incredibly successful (the HK DPR1001, 1005, and 2005) that they are are no longer sold. If Class D was the miracle you make it out to be, HK should have ruled the world. Even Audioholics' own reviews of the HK's state that Class D is still years away from audiophile quality.
Class D amps have found a home in some sub-woofers, to be true, but let's face it, they ARE NOT used for anything that stresses mid or tweeter work. Subs are the one place you can amplify junk noise without much chance of it being noticed.
There's your break... right in the middle of your logic !