Trains are a great means of transportation, but aren't well suited to sparsely populated areas, of which there are many in the U.S. For travel of under four hours, high speed rail would be a great upgrade over flying for a variety of reasons, but the U.S. public is skeptical for some reasonable (cost) and some bad (years of successful auto lobbying) reasons. We are decades behind the rest of "the west" on this, likely because in the 1950s we had so much land, so much industrial production, and so much oil. Our current economy is much better suited to trains, but we haven't recovered from our fixation on the car, and just because many areas of our country are suited for trains, doesn't mean all are.
Well, the high speed rail I'm most familiar with is the idea of SoCal (LA, possibly somewhere south) to NorCal (San Jose / San Francisco). The problem is that I don't see how it's an upgrade over flying or driving. Granted, it does violate your 4-hour distance, as it's closer to 5-6. But I highlight it as it's an EXTREMELY popular route, including to the point that I've flown from Orange County to San Jose in the morning for business travel, and flown back the same night, and seen multiple people on the evening flight that I saw on the morning flight.
Flying is easy. There are 5 airports in the LA/OC metro area (LAX, Orange County, Long Beach, Burbank, and Ontario) and one in San Diego. There are 3 airports in the SF Bay Area (San Francisco, San Jose, Oakland). So for the bulk of the population of either metro, you're not more than 30 minutes drive from one of those airports. From any one of these, it's a 1 hr flight between them. Even including driving to the airport, navigating security, boarding, flight time, deboarding, and getting a rental car, you're probably within 4 hrs. Even if you're going to SF and want to take BART from SFO to downtown, it's still pretty darn quick.
Contrast that to high speed rail. Although they call it "high speed", it's going to be difficult to make the trip from downtown LA to SF in less than 6 hours. They could easily do it if they don't stop along the route, but politically they can't build it if it doesn't have a few stops along the way. And logically, it's hard to justify ridership if it doesn't stop in San Jose and bypasses it to go straight to SF. And that's assuming they can build it to go anywhere close to the downtown of either place, which will be a nightmare. That also doesn't include the transit time that I included above to get to the station [airport], to get through a terminal, for the boarding/deboarding process, etc. I'll bet that including transit time *IF* you live near the station, you're looking at 8 hrs.
For me, to get to downtown LA is somewhere between a 1 and 2 hour process. So unless they extend the rail line much farther south, I have to either drive to LA (ugh!) or take a train into LA and hope that they find a way to terminate the high speed rail at Union Station.
Everyone says it's got great advantages over flying, but I fail to see what those advantages are. I can see it for very short trips (i.e. Los Angeles to San Diego), particularly if you know you won't need a car when you get where you're going. But otherwise it's more hassle, more cost, and more time than anything else.