Essentially Muslims have no real religious reason to have a particular mosque in a particular place. Islam is a religion that does not give any relevance to where you pray to Allah. Muslim scholars can accept this easily, if the entire atmosphere of coercion ceases to exist. In other words, if you are true believer, any Masjid is just a building.

I am not sure this is the same for Jews as well.