Ator, you have re-discovered what many of us learned the same way. The advantage of a separate amp paired with a top shelf AVR is tenuous.
The additional power is often superfluous, especially at normal volumes in a normal room. However, most of us who did the same thing you did, kept our amps. (I am currently the proud owner of an XPA-5, just like you.)
The amp will give you assurance, peace of mind, that any perceived shortcomings in your system are not power related.
You'll never have to worry, or even consider, the sensitivity of speakers you want.
The 5 LEDs on front of the XPA-5 look really cool as they sequence on.
Your bragging rights are substantially enhanced when telling/showing your system to normal friends.
Now that you know, even with 200wpc, your system doesn't sound the way you want, you can be relatively sure it is your speakers and/or sub(s). My suggestion is to keep the amp, and continue your quest for speakers & subs. If you sell the amp and get new speakers, you'll always wonder if they would sound better with an amp.