i take it that your main speakers are on the floor, shelf, or stands. my point, they are out from the wall. if so, i see it being ok for the center to be out from the wall.
i don't like speakers that are forward of the display. so i would move the tv out some.