Set it to whatever sounds best to your ears.
If you can't tell a difference between Large and Small, then I would set them all to small. That will take some strain off of your receiver by letting the sub take care of eveything under 80Hz.
Most wiil tell you to set it to small with xover @ 80Hz.