KEF has a much better reputation among audiophiles because KEF (like Revel, RBH, Focal, Dynaudio, Monitor Audio, and few others) make speakers that are accurate in measurements.
B&W get some bashing because even their $30,000 speakers have on-axis and off-axis measurements (from Stereophile and S&V magazine, not from consumers) that are WORSE than some cheap Infinity Primus speakers.
Of course, measurements don't guarantee better sound. But a lot of people talk about on-axis and off-axis measurements. So if a $30,000 speaker has a +5dB peak at 10kHz, it will raise eyebrows among audiophiles.
So it depends on how you feel about this perception. Do you care how your peers feel in general about certain brands?
I used to own the B&W 802D2 and I thought they sounded just fine.