I think about which team I really hate losing to as the biggest rival, or one of.
But losing a KEY game that is pivotal is worse (but often the same of course). Imagine UGA gets upset by Tech, but wins the SEC, that is MUCH better than losing to Tennessee or Florida and not making the CG. Losing to Auburn is also better because they are in the West.