This is a hobby of personal preferences. If your setup sounds better to you with the speakers on, then go for it. If you prefer them off, then go for that.
If it sounds better one way for music and the other way for video, then switch them on or off as you wish.
Personally, I prefer them off but there is no right or wrong here. It's your system, your room, and your ears, not mine.