You could contact paridigm to see if the will just sell the grill and holder, so you don't have a gaping hole.
I know that RBH just sells the grill and enclosure specificially for this purpose.
Or just leave them if they are really old. Ususally with houses, they won't pass FHA loans if you had the holes in the walls.