Folks could focus on the few occasions where a loss had no, or limited, negative impact, or look overall and see how it USUALLY does. Either way, it's just complaining without proposing some kind of systemic change in THE SYSTEM.
How often has some late loss bounced a team from the BCS or CFP? Sure, it matters, with a very few exceptions. We have this committee system now, I haven't heard anyone suggest anything different from that.