Take a look at the Leviton Quickport series. They have many different connectors that can be mixed and matched like RCA, F, BNC, Phone, Ethernet, and even binding posts. The connectors and wall plates are bought seperatly and the connectors just snap in the plates in what ever configuration you need.
BTW: I think the RCA type would be fine for component video and coaxial digital audio. I don't think they make an optical one.