The "classic" approach is to hook everything to the AVR and use the AVR for audio and as a source selector.
ARC / eARC may change that, just depends. Mostly, it depends on how well your ARC/eARC works/does not work. It is hit or miss.
How do you have it all connected now?
You may need more than 1 remote, or may need universal remote.