You are correct, but missing the point. A single point measurement doesn't represent what we hear in the listening position for several reasons. First, we hear with two ears, and the mic position most often used won't even be in the position of one ear. Second, spacial hearing includes mechanisms that are able to discriminate sounds both spacially, temporally, with an acoustic receptor system that is nothing like an omnidirectional mic in an acoustics space. To even approximate that, along with the imprecision of head position (you don't lock your head in a vise), we have to have more measurement points, even if they are clustered closely in the listening position. It's not so much wanting to see a smooth plot, but rather ignoring single position anomalies that aren't audible or repeatable.
All precision measurement methods involve more than one mic position. Commercial theater alignment has done this for many years, with some systems utilizing multiple mics and a multiplexer to save alignment time. THX insists on multiple measurement positions during calibration of home and theaters. Audyssey recommends using multiple mic positions, though their method of measurement combining isn't an average, but something more complex.
All of this is especially true in a small room, because variations between mic position results are usually more significant than the variations you'd get from similarly spaced mic positions in a large space. I'm not suggesting averaging mic positions 10' apart in a small room, but rather averaging several mic positions around your favorite seat, if that's what you want to optimize. Otherwise you end up with lots of detail, warts and all, but that's not what you hear, so there's no point to it.