Do I need to be in the UAE to set up a company in Umm Al Quwain Free Trade Zone?

No, you don’t need to be in the country, but you will be required to visit. You will have to visit the UAE at least once.