Do I need to have an actual office space to set up my company in Umm Al Quwain Free Trade Zone?

There is no requirement for an office space to set up a company in the UAQ. However, if you want a visa, then you will need an office.