Sometimes a screw can come loose... it happened on some speakers I have.
Once I figured out what was happening, I took the screwdriver to all my drivers just to make certain!
I'd just go over it again and check everything that isn't glues down.
Also since you popped the driver out, you might want to consider putting some sealer tape or some such to help close that up proper!