Everything has it's limits.
When you're alone, you most likely don't have a lot of background noise to overcome. Ergo, your system is fine under normal conditions.
Now, when you have to overcome a lot o background noise, one'snatural inclination to "turn it up" and, to an extent, that is fine.
Since your receiver is rated at 85 wpc and your speakers are speced to handle a max o 120 watts, going up to an amp that would generate that would yeild approximately one measly decible of increased loudness.
So, I'd say that your limits are defined by both the receiver and the speakers, not to mention your unrealistic expectations.
For a party system you need more efficient speakers that can move more air with less power, and more power.