Matt,
First of all, WELCOME to the site !
I'm not sure that I've had the exact problem you're having, but there's a couple things you might check.
First, read my #36 post here on this thread, there may be something in it, that will help, and I'm thinking about the Ground Verification of your Receptacles. Get a long piece of standard jacketed Wire (16/14/12 Ga) and connect one end to a KNOWN good ground. Cold water pipe under a sink, or the metal part of the building (commercial) and check EVERY Receptacle that you are using for your system for a solid ground (the round hole). Using the Ohms Scale, you should verify Zero the meter out by touching the two leads together WITH the long lead in place, and use that reading as an acceptable Zero when you move out to the Receptacles. You shouldn't get more than a 0.001 Ohms reading, when probing into the Ground pin. If it's open, then you need to re-run the Ground in some way. Good luck with that!
While you're at it, (hopefully with a Digital Meter) verify that the Hot wire for the receptacle is showing up on the
smaller of the two blades, if not, they you've got Reversed Polarity, and it's easy enough to swap the wires on that Receptacle. Don't forget to change to the Voltage Scale for this one !
You're mentioning lots of components there, check each one for continuity of Ground, from the Case to the Round Pin of the Power Cord for that component. Some of those molded Plugs on those things are made real cheep, and it's easy to assume that they're ok, but, don't make that assumption, check each one, including the Computer, ALL !
Now, I don't know if you are using any Two (2) Wire Power Corded equipment, and if you are and it's relatively new, the Plug on them is Polarized, where there are two different sized Blades, and if that's the case, you can't reverse connect them. But, if there's an older piece in your setup, and it doesn't have a polarized plug on it, you might try turning the plug over in the receptacle, and then marking it with White Out or something, where you can ID the better placement.
Lastly, you might do a Pin to Pin on the interconnect Cable (s), some/most carry a ground in them. It doesn't matter which wire of a multiple wire cable that carry's the ground, as long as the individual wires have continuity end to end, and there's NO cross connections between them. That type cable is made cheaply too, don't trust them either.
Problems like you have are like Roaches, very hard to get rid of !
Hope this helps !
Have a good Day !