Whoops, I left out something.
When cutting a recess to flush mount a speaker, I first cut the large diameter recess with a 1¼" mortise bit and a circle cutting jig. When that is cut deep enough to allow flush mounting the tweeter flange along with any sealing gasket, I then switch to a ¼" bit and cut the smaller diameter hole through the front baffle.