Traffic is likely to be bad near any nicer place, and costs will be higher, demand and all that.
Traffic rarely impacts us here, even though it's "bad". Even when we drove our friend to the airport a few weeks back at 5 PM, it was "tolerable", better than I expected really. The side streets are usually OK unless there is construction.
And we avoid going out near 5 PM if we can.