Crossover frequency is the freqency where a different driver on the speaker takes over. For instance, on a largish 2-way bookshelf speaker (consisting of an 8" Mid/Woofer and a 1" Dome tweeter), the woofer would handle frequencies from about 45Hz to about 2500-3000Hz. After this, the signal crosses over to the tweeter for output.
Freqency range is the entire range of output a speaker can produce, this being optimally 20Hz to 20kHz. Of course, you need a fairly large floorstanding speaker to achieve this kind of range.
Most people using bookshelf speakers or even floorstanders, will use a subwoofer to handle the freqencies from around 20Hz to 60-80Hz (another crossover point). The THX standard for subwoofer crossover point is 80Hz.