For me, pretty much if it will not be a music only system, I almost always go with bookshelf speakers. I also tend to go with the larger ones and a good sub. For a music only system, I will almost always go with a tower, but that may still include a sub.
I have similar thinking, and here's why.
For TV/movies, (things in 5.1 or 7.1), there IS that Low Frequency Effect channel, and the crossover of the "normal" bass frequencies does not seem as critical. With a competent sub or subs, I think you and your AVR can manage the bass crossover adequately.
For music, the bass transitions are more critical. By "bass transitions" I mean the sound moving from driver to driver... like from the tweeter to the midrange, then the mid to the woofer, and the woofer to the subwoofer.
A good speaker designer understands these transitions FAR better than I. Even a lousy designer knows more than I. The designer accommodates these transitions via both the cabinet and crossover design. There is NO way I think I can do a better job by getting a subwoofer and managing the crossover with the AVR myself. So I would much prefer to get a full range speaker for music, and utilize the expertise of the speaker designer.
That's why I have my Left/Right speakers setup as "Large". In stereo mode, (music), my 2 very capable subwoofers are silent. Because of my reasoning above, I did go with the legend Dennis Murphy for my Left/Right. (OK... maybe he's not really a legend, but he is highly regarded.)
I tell people I've only done 2 smart things in my life.
1) Married my wife.
2) Let her handle our household budget.
The truth is, I did another smart thing. That is to let Dennis Murphy handle the design of my bass crossover for music within his Phil 3s, rather than try to do it myself with the Denon and subwoofers.