I'd go naked if the speakers were artfully designed for that, rather than the typical few concentric rings and cones. I also think the black faces of grills tend to have a higher WAF than bare. I currently keep the grills on my great set of Aperions because of small children and cats, but with that not a concern and some interesting designs, I'd certainly reconsider.
Cheers,
Kevin