Right, because cars are the same as speakers.
Sure, mass is Mass, but low Mass moves easily and it slows easily too, and speaker cones are low mass. Any cone with more Mass will have a stronger magnet and voice coil that will be appropriate for that cone, assuming it was designed properly. Besides, woofers aren't used for high frequencies, so your argument is moot.
See- Physic is fun. You should stop assuming things about larger diameter drivers.