Jack,
Have a read through this link:
http://www.acoustics101.com/hvac.asp
I put the page together back when I was with Auralex. There are quite a few sources to consider when addressing HVAC noise. Some are relatively easy fixes; others not so much.
The two most likely sources are blower (air handler) noise and turbulent air noise. The former will have more LF content ("rumble," "roar"); the latter will have more HF content ("hiss," "whistle," "whoosh"). If you have a sound level meter, you should be able to get a (very) general idea of frequency content by comparing the A-weighted and C-weighted readings. If they're roughly the same, high frequency noise is (more or less) dominating. If they're quite different (dBA less than dBC), low frequency noise is (more or less) dominant. Note that you should use a windscreen if you're measuring sound close to the intake.
Insulative approaches are very effective for HF problems. More (longer) duct - also insulated - is a good approach for the LF stuff, among others.
All of which you may have very little control over, unfortunately...