What brand is your tape deck?
In the early 1970's, I owned a German Uher tape deck. Once in awhile, I was getting some "beeps" when I was recording with it.
Bell Canada telephone company had an antenna tower nearby and I suspected them to cause the interference. One of their people came over to the house and denied that they could cause interference. I got fed up with the machine, sold it and replaced it with a Sony tape deck and no more problem since.