I would send the HDMI to the TV, so you get picture and sound to the TV in the situations where you don’t whish to use the AVR for sound. I would then make a second connection with digital coaxial or toslink to carry sound to the AVR when you actually want to us it. You will need to shut the TV’s speakers off when you useing the AVR, if you want to do things properly. But you will need to turn them back on when go to shut the AVR off