وَإِذْ قَالَ إِبْرَاهِيمُ رَبِّ اجْعَلْ هَٰذَا الْبَلَدَ آمِنًا وَاجْنُبْنِي وَبَنِيَّ أَن نَّعْبُدَ الْأَصْنَامَ

Prior to the advent of the period of Abraham, the condition of countries and communities had become such that polytheism (ascribing partners to God—shirk) had become the order of the day. The sun, the moon and other natural phenomena had become objects of worship. In ancient times, polytheism became so dominant over all activities of life that it thrived from one generation to the next. It seemed impossible that people could be taken away from the atmosphere of polytheism and brought into the sphere of belief in the unity of God—monotheism (tawhid). At that time, at the especial behest of God, Abraham left Iraq and entered the Arabian desert, which was a desolate place, far away from civilization. In this isolated atmosphere, he settled his wife, Hagar (Hajrah), and his son, Ishmael (Isma‘il), so that a new generation would grow up, which would be cut off from the polytheistic trend prevalent at the time, and which, having been brought up in a free atmosphere, would follow its true nature in its formation. Abraham’s statement reveals this particular fact in prayer-like style. This was God’s plan in settling the children of Ishmael in a dry and deserted place. Now, the people who made the unity of God (tawhid) the voice of their hearts, were, so to say, the true fruits of the Garden of Abraham. By contrast, the people of this place who reverted to the way of polytheism (shirk) would be treated as the poisonous weeds of this Garden.

— Source: Tazkirul Quran (Maulana Wahiduddin Khan) via Quran.com (14:35)