When it comes to subwoofers my belief is that size does matter. (provided everything else is equal) A subwoofers main job is life is to move large amounts of air so it can effectively shake everything in your room. A small driver has to travel further than a large driver does to move the same amount of air. This adds the possibility of increased distortion and various non-linearities such as dynamic compression. That said - quality of the drivers and amplifiers utilized as well as the design of the enclosure will have a large effect on the total outcome.
What shakes my world is a JBL 4645C 18" THX certified passive subwoofer. I purchased a Rythmik audio A350 plate amplifier and installed into the cabinet with great results. The Rythmik puts out approx 250WRMS into the 8 ohm load that the driver presents to it. With the 99db efficiency of the 4645C it makes quite a potent mover of air and it goes as deep as I would care it to.
Please note - this system doesn't score well on the WAF. (I believe I heard the word ridicious)