It depends on the amplifier power and topology, plus exactly how it is connected to a human body; the more powerful amplifiers are delivering more than less powerful ones.
By "more" I mean this is determined by the topology; a voltage Power Amplifier (most) would be delivering more voltage (volts), a current topology Power Amplifier (rare, but they do exist) would be delivering more current (amps).
You could connect the terminals to areas of the body more sensitive to electricity than others, for example if you were to hold each terminal (one positive, one negative, for one channel of a Power Amplifier's output) in each hand, you would need a very powerful amplifier to have some risk, while there are definitely areas of the body that are far more sensitive to electricity that would have greater risk.
Also there is always the possibility of a Power Amplifier operating in one or another failure mode, where the normal limits on output power ... that is an amp working properly into an expected speaker load .... are no longer in effect, and, basically, "anything goes".
Most commercial Power Amplifiers have protection circuitry designed to limit or eliminate problems, but they are not 100% reliable and some, especially those built to extract the last bit of resolution, may have limited or no protection circuit. This would be a situation where damage to the speaker would result, except you are connected to a human body, not a speaker.
In the end you must keep in mind that you are connected, through the Power Amplifier, to the household current of 120V/60Hz AC, which is definitely dangerous. Abnormal conditions means all bets are off, basically.
Broadly speaking the specific risk as your question describes is low, because the natural impedance of dry skin on the human body is high ... typically 100,000 Ohms (the Power Amplifier expects perhaps 2 to 16 Ohms; higher impedance means less power is delivered).
However it would be wrong to say the risk is zero; and the impedance of the body is not fixed. It varies from person to person, time of day, and whether dry or wet. Again, another example is on the same part of the body where impedance with dry skin would be 100K Ohms it might be only 1,000 Ohms (1K Ohms) if wet.
From the above you can see that you could detect electrical charge on a 9V battery on your toungue (wet, sensitive, internal) but not on the back of your hand (dry, insensitive, external). Things like that affect the risk.
There is no "black and white" answer to electrical shock questions; in some cases very low currents can be dangerous while in others very high voltages could be relatively safe (for example, tesla coils). Far better is to adopt "best practices" when dealing with electricity, which could be summed up as "don't take chances".
It's something I would not worry about, personally, as far as they typical home audio system is concerned, but do try to avoid connecting yourself to electrical devices; it is not a good idea.