It is no surprise that you prefer headphones to speakers.
Modestly good headphones blow away average living room HTIBs and even average "casual listening" setups when it comes to accuracy. The headphones will also have better low end extension with lower distortion. The biggest drawback with headphones is that even with the best of them, one can never get as big a soundstage (apparent left to right width of individual sources) and good imaging (ability to give front to back depth to sound) individual sources), when compared with speakers. The second drawback it in lack of tactile feel of bass.
The best example I can think of is, Pink Floyd - Time. At the beginning of the track there is some drum improvisation. On my headphones, everything sound crystal clear, but, everything is happening inside my head, between the ears. When I play the track on my speakers, it almost feels like I am playing the drums. Leaning forward and back as I hit higher and lower tom-toms or reaching up to hit the cymbals. The effect is visceral. That said, I can also tell that the sound is slightly less accurate than the headphones because of extra reverberation that the room has introduced.
In a properly set up dedicated room with reasonably accurate speakers, the soundstage, imaging and tactile feel will trump the headphone "experience".
