That sounds pretty normal. Movies are mixed so that most of the sound emanates from the center speaker, less from the right and left fronts, and even less from the surrounds.
Stereo music, or two channel music, is mixed to have steady and constant output from the front left and tight speakers. Theoretically, in pure stereo mode, you won't get anything from the center or surrounds.