Given that you were "on holiday" I'm assuming you're not from the US, let alone from New York. You said he's Brazillian but not if he's actually living in Brazil at the moment or living somewhere in the US or whatever country you're from.
So I'm just going to assume you're both from opposite corners of the world. Let it go. Long distance isn't worth it for a stranger flirting with you at a bar. There will be more strangers flirting with you in more bars who live closer.
There's no harm in being a little cautious around people you don't know~! But if you can do something to make yourself feel better, maybe get in touch with him if you can. Give it a shot. But otherwise, don't beat yourself up about it! It might have been something you regret, or in the long run, been a good decision. You just never know!