The receiver is working as designed, the hub for all sources with one (or more) TV out. There is no way to avoid having to change inputs on the receiver.
Have you looked into getting a universal remote? You can program it to turn on devices and change inputs as needed. Best of all, you can put away all the other remotes and not have to worry about your settings getting changed by accident. Logitech Harmony offers a web interface wizard that takes the pain out of the programming process.