Gosh, Bassman, I had an old pair of SM122's and took the woofs out numerous times. I don't remember the plastic trim rings being glued on at all! Are you sure they aren't just sticky and stuck on? Take a look on ebay and see what kind of parts are on there. When I scrapped my 122's a few years ago, I parted them out and sold them on ebay. I was surprised to find there is a big parts market out there for Infinitys. People are parting them out left and right. There is also a big market for the foam repair kits for infinity's. I just checked there and one of the sellers said if you had any questions he would answer them.
I have some Infinity Reference One bookshelfs in my bedroom system for surrounds, and just checked. They have the same trim ring as my old 122's. They are held on with alan head screws and should pop right off! Unless someone glued them on! At which point you are gonna have to get them off anyhow and can't worry about breaking them. The speaker basket should bolt back on without the trim ring just fine- I think they are mostly aesthetic anyway.............HTH.