Yeah, I've seen several authors have cultures where the muslims pray towards a mosque erected near the first landing site.

And in one shared universe the Arabs (who were excluded from a deal that let a number of other nations "earn" the right to get people rescued from a coming alien invasion) managed to build their own starship based on a very obsolete (thousands of years) design in a database the aliens had shared with the folks they were letting come.

They took a piece of the Kabba with them to be incorporated in a mosque to be built on their colony. sensible, that.