I have found out that this sounds like a terrible idea. There is an alignment to the voice coil that is controlled by two things: the spider and the surround. If either one comes loose the alignment is off. Realignment of the voice coil is probably outside of the abilities of a person wondering about which glue to use for a spider.
I'm going to have it taken care of by a shop.