In the ideal world you have all speakers match. That eliminates chance that they will have audible and annoying differences. That being said, I have had totally different brand center channels and have been happy, MOSTLY (probably blind luck). The time when it was not good was when I did the first upgrade of my tower speakers. The sensitivity of the new towers and output destroyed my poor old and small center. That was before room correction software which would have lessoned the deficiency. You don't know what you don't experience.
My LCR are from the same product line now, and it really is audible bliss. Surround music tracks also benefit from matching speakers, plus it looks better.
Worst case, try to match specs and driver materials as best you can and be happy.