Where I live is far enough from the San Andreas that even a large quake wouldn't cause a major problem (for my house structurally that is--obviously it could seriously impact a lot of utilities/public services). And there are no significant known faults nearby that would cause more than a little shake if one of them lets off a little energy.
I'm also not rich enough to live near hills or trees, so wildfires and mudslides aren't a problem for me.
And I'm 5-6 miles inland at almost 700 feet elevation, with foothills directly between me and the ocean, so nothing the Pacific could do (tsunami, sea level rise, etc) will get me.
Tornadoes here are EXCEEDINGLY rare (but apparently we just had one this season), as are thunderstorms, and snow will almost never drop below about 2000-2500 feet elevation.
So I have very little to worry about.
And I'll argue with just about anyone that Southern California has the best weather, year-round, of anywhere in the US.
Which is probably why cost of living is so massive, and traffic sucks, and so many people are willing to live here DESPITE what Sacramento does to us.