Good relevant and often overlooked matters mentioned by Goliath.
Going with a somewhat larger scope, any possibility of something else wrong - loudspeakers at low amplitude (something physical in the air gap), or the particular amplifier doing something there? For a complete analysis I would include those.
As a general remark, yes, one would expect amplifiers to be blameless at low volumes. But though the exception, they are still occasionally not! Separate parameters determine amplifier performance there. For completeness sake I would check performance at low level of both loudspeaker and amplifier, just to rule that out.