I think if you have $5 mil pretax and have reasonable spending patterns, you are indeed set barring a real meltdown.
If you have $2 mil, you're good if you own your living space, or close to it, and don't have other loans. A real meltdown would of course hit everyone.