For music or HT? Big difference.
For HT, the center is the key and the other speakers are second bananas. For music, however, where it's spread pretty evenly across (at least) the front half of the room they become more of an issue. A sub is great for filling in the low lows but, for anything above that, it's nice if the speakers can handle their own.
Your mains dont need to be able to go down to 20 hz. As long as they don't "fart out" when you're ok feeding them a full range signal. Many better speakers simply ignore whatever bass they can't handle. Of course, boosting the bass controls on the amp can exacerbate this problem.
Miy mains (Athena Audition AS-F1) are only rated to 40 hz and they handle a full range signal with no problems. Likewise, so does my matching center channel (AS-C1) and rear surrounds (AS-B2).
...and I DO have a subwoofer.