Folks who find fault with Texas appear to think that. Perhaps I over stated the point, but I think many think a loss to a credible team is more relevant to your status than a clear upset loss in a "fluke". Take Ole Miss, for example, the loss to UK is somewhat excused, the loss to LSU now also looks pretty weak as well, but they are the second top ranked two loss team, to Alabama, who has the "excused" loss to Vandy, and a credible loss to Tenn.
Maybe I disproved my "point". It happens.