IR tends to go through glass just fine, so I think it would probably work ok through acrylic. It may present a problem with cheaper remotes with low power transmitters but the better universals like Home Theater Master and I assume Harmony should work.
If it doesn't work well enough, you could get a remote with RF capability, like the HTM MX-350, so you don't need line of sight to the components.