I just ignore them and walk away quickly, paying them no attention. One gimmick they have is to scare you into reaching for your wallet so they know where it is. I would not stand for 5 seconds having words with them ever. Once you get away from the touristy areas they are not there.