I know I can't handle a "performance car" very well at all, even on a track. They're beyond my capabilities. But it's fun to try, on a track.
I'm somewhat the opposite. I'm no race car driver, but back when I had my motorcycle I was one of the quicker guys on the track, even though I was deeply behind other guys on the same bike in power:weight ratio lol...
Same with any various of the indoor higher-performance go kart tracks... We did a big event for a work thing a few years back, and out of 70 people participating, I was 3rd-fastest. Again, with one of the worst power:weight ratios of anyone in the entire field.
I view at as combination of two things... One is understanding the actual physics of racing... Optimal racing lines, weight transfer, etc to get the most out of what you have. The other is the willingness to push until I start finding the limits, which a lot of people are terrified to do. I'm intellectual enough to know what to do on a racetrack, and stupid enough to try it
Now, if you're talking about
supercars, I agree that by the time we reach their limits, I'm exceeding mine. But in any given performance driving "competition" against the general public, I'd probably claim I'd be at the very least in the upper decile of lap times, and maybe even top 5%.