Just to build upon XEagleDriver's nice explanation:
here is a rough analogy that is easy to picture and helps you to understand what is going on
As XEagleDriver pointed out, it is all about amplitude.
Picture a small cork floating in a still pool of water. You can push down on that cork and allow it to pop back up. If you push it down and let it pop back up with a steady, even rhythm, you'll create a nice wave along the water's surface.
Now, if we want to make waves in the water that sort of resemble sound waves, then they have to be nice and smooth and even with that perfect sin wave shape that you would see on an oscilloscope. In order to create those kinds of waves by pushing down on our small cork and letting it pop back up, we cannot push it below the surface of the water, nor can we allow it to "jump" above the surface of the water. That would create weird, uneven ripples and wouldn't let us produce that nice, even sin wave shape. Also, the up and down motion would have to be nice and steady. You couldn't push it down quickly, hold it down and then let it pop back up. That would create "gaps" in the wave and wouldn't create that nice, even sin wave shape.
So even just picturing that in your mind, it's rather easy to picture that if you're pushing the small cork down and letting it pop back up at quite a fast rate (high frequency), you can create waves that are fairly tall. The height of the waves is the amplitude - and if they were sound waves, that would be the "loudness" of the sound.
It's also easy to picture that if you push that cork down slowly and let it pop back up slowly (a low frequency), you're going to create very shallow waves that have very little height (amplitude).
Now, if we replace the small cork with a big disc, again, it's pretty easy to picture what happens. With that large surface area being able to displace so much more water than the small cork, we can also create taller waves at lower frequencies.
This analogy also makes it easy to understand some other concepts. For example, it's fairly easy to picture that you could create the same height waves using something with the diameter of the small cork rather than the big disc, but that smaller diameter device would have to be much, much taller so that you could push it much deeper into the water in order to create the same height in the waves. This helps you to picture the concept of driver excursion in a speaker. You could play loud (high amplitude), low frequency notes with a small driver (like a tweeter), but it would have to move really far out and really far back in - it would have to have HUGE excursion. So it is much, much, much more efficient to use a big disc in the water or a speaker driver that has a much larger diameter. It can create higher amplitude, low frequency waves without needing the same massive excursion as a small diameter driver.
On the other end of the spectrum, if you're pushing down on that big disc in the water with your finger, it's pretty easy to push it down and have it pop back up at a nice, slow rhythm. But try to move it really quickly and it gets tough. All of that big surface area doesn't easily move up and down quickly. It's much easier to bob that small cork up and down at a fast rate vs the big disc.
In the end, if the idea is to create waves of the same height (amplitude) regardless of the frequency, then it just makes sense to use a small diameter device for the high frequencies and a large diameter device for the low frequencies. Either diameter can do the entire job, but it becomes inefficient. The small diameter driver has to move extremely far in order to create the low frequencies (at the same amplitude as the high frequencies) and the big disc is difficult to move quickly, but rather easy to move at slow, low frequencies.
This is by no means a proper scientific explanation! But it's just an easy way to sort of picture what is going on and get a grasp on why speakers use small tweeters for the high frequencies and large drivers for the low frequencies