First off, I am no expert at measurement, so don't take what I say as gospel. Hopefully someone more experienced will be along before too long, but, in the mean time, I will stick with you and learn as we go!
I think you are expecting a more vertical slope than you should be. If your horizontal axis is spread out, the visual angle of the slope is less.
Here is a graph of the theoretical crossover:
Note the curve is 6dB down at the 80Hz XO point and has a 12dB/octave roll-off (you can see it goes from ~63dB @ 40Hz to ~51dB @ 20Hz).
The 12dB roll-off can only be evaluated where the slope is steady (not where there is any curvature to the chart).