I presume in such a national poll, the major programs with the largest fan bases will be over represented. So, OSU fans, being most numerous, probably, would nearly all say Michigan has the most annoying fans.
"Most annoying" doesn't necessarily mean "bad fans". The fans of a team that routinely beats you can be annoying.