Doing a quick Google search, it would appear that you're not the only one having the issue. One guy said Amazon responded to him saying they were aware of the problem and are working on a solution. My guess is it's something software based on the Fire TV side. Also saw one guy saying he isolated the problem to some app running in the background. A podcast app. He removed that and the problem went away. Have you given Amazon customer service a call? Not that they'll do much, but hopefully if enough people complain about the issue, they'll actually work on an update that fixes that specific issue.