Yes all of that, plus even if you made the battery bank modular and removeable without jeopardizing the vehicle's structural integrity, you'd still have the simple logistical and mechanical issues of replacing these battery banks "at the pump."
Self-serve would be gone, and the amount of human interaction required "at the pump" would increase dramatically, as would the execution time and the wait time. Presumably, eventually, robots could be used, but I'd say that's a very long way off in practical application.