As far as an implication that the voters are like sheep in the sense they all do the same thing, I'd bet a small amount that the voting ballots vary considerably. I'd guess each voter uses different criteria and reaches mostly a different ranking, more so further down of course. I know somewhere publishes each individual ranking, or used to.
My own "system" would ask simply who would beat who on a neutral field, which might be closer to how the committee thinks. H2H yields odd results, often as not, if over weighted, in my view. Even a good team can stink it up and lose one they shouldn't, and wouldn't 9 times in 10. UGA could lose to Tenn this Saturday and probably not drop too far. The other top ten teams don't look all that great either, they all have blemishes.
Ranking 2-10 right now is going to generate varied opinions. I don't think of that as sheeplish. I also don't think it matters.
