As long as you have a load, which could be a resistor (test equipment) or a loudspeaker, connected to one of the vacuum tube amp's output terminals ... doesn't matter if it's the 4 ohm or 8 ohm taps ... you won't "blow" the amp.
Tube amps with output transformers (or some Solid State amps with output transformers, although rare today) deliver the same power to any load that matches the output transformer tap.
So 100w into 4 ohms via the 4 ohm tap, or 100w into 8 ohms via the 8 ohm tap. If the speaker impedance and the selected transformer tap are mismatched, less power will be delivered to the speaker.
I am curious, however, about your speakers. Infinity is well known for having low impedance, often dipping to 4 ohms or lower. You provide plenty of details about everything *except* the loudspeakers. They are more important than the turntable in so far as your question.
Exactly which model Infinities do you have, and are there any reviews / tests available on them? I very much suspect they may sound best connected to the 4 ohm taps on your amp. You won't damage your amp by connecting them to the 4 ohm tap.
Just a heads-up ... NEVER connect or dis-connect loudspeaker cables (either at the amp or the speaker) with the amp powered up. Turn it off first.