For me, the concept of imaginary numbers is the craziest one. It's literally something that is of tremendous value in so much of science. And it's based on a concept that literally cannot exist; the square root of a negative number.
It's something that doesn't exist--can't exist--and yet is incredibly useful.