I don't like the idea at all. Why take something that works, the remote control, and make it run through a game console so you can sit there waving your arms at the camera until you get frustrated enough to go and pick up the remote.
I use Kinect for my kids and wife, and then unplug it from...