Electrolytic capacitors are used in lower cost speaker crossovers. They were even used in some hi-fi speakers for the primary filter components 2 or 3 decades ago. Dynaco is a good example of a popular hi-fi company that used electrolytic capacitors in their crossovers in that era. In addition, even many modern hi-fi speakers, you can find electrolytic capacitors in part of the crossover: the Zobel network(s). The Zobel network is not very sensitive to considerable value drifts, but typically it requires very large values that would become relatively expensive if a poly or mylar film capacitor was used. Perhaps you are thinking about typical polarized electrolytic capacitors which would not normally work in an A.C. circuit without failure. However, the type used in speaker crossovers is non-polarized electrolytic. You can find this variety sold 'as' speaker crossover capacitors at just about any speaker parts supply house such as Parts Express.
-Chris