The Ultras don't have a sub on the sides. Just regular woofers.
But yes, the Prime and Ultra lines are voice matched. Keep in mind you do get more premium components in the Ultra series, so slightly better performance. But otherwise, mix and match to your hearts content.
***Edit for clarification: Not every company voice matches their lines, so not a rule of thumb... However, SVS does, so you are safe here.