Dude, stand next to a full length mirror some time with Khakis, black socks, and white running shoes. Even though you only see an inch or less of sock, it's enough to make you look like a bafoon. Or throw on a dark suit with white sport socks. Especially noticable if you sit down.
Why match your clothes at all? Why not just wear an old burlap sack, or an oak barrel with suspenders? You either want to look presentable and nice, or you don't care. If you don't care, then wear whatever crazy socks you wanna wear. But no matter what, they ARE visible at some point, and you DO look like a moron.