Muwatta Imam Malik Book of Hajj, Hadith 105

Yahya related to me from Malik from Ibn Shihab from Salim ibn Abdullah that Abdullah ibn Muhammad ibn Abi Bakras-Siddiq told Abdullah ibn Umar from A'isha, that the Prophet ﷺ said, "Don't you see that when your people built the Kaba they fell short of the foundations of Ibrahim?" A'isha said, "Messenger of Allah, won't you return it to the foundations of Ibrahim?" and the Messenger of Allah ﷺ said, "If it were not that your people have only recently left kufr, I would have done so."
Salim ibn Abdullah said that Abdullah ibn Umar said, "If A'isha heard this from the Messenger of Allah ﷺ then I consider that the Messenger of Allah ﷺ only refrained from greeting the two corners which are adjacent to the Hijr because the House had not been completed on the foundations of Ibrahim." (i.e. the corners he did not touch were not the original corners of the Kaba) .

حَدَّثَنِي يَحْيَى، عَنْ مَالِكٍ، عَنِ ابْنِ شِهَابٍ، عَنْ سَالِمِ بْنِ عَبْدِ اللَّهِ، أَنَّ عَبْدَ اللَّهِ بْنَ مُحَمَّدِ بْنِ أَبِي بَكْرٍ الصِّدِّيقِ، أَخْبَرَ عَبْدَ اللَّهِ بْنَ عُمَرَ، عَنْ عَائِشَةَ، أَنَّ النَّبِيَّ ﷺ قَالَ " أَلَمْ تَرَىْ أَنَّ قَوْمَكِ حِينَ بَنَوُا الْكَعْبَةَ اقْتَصَرُوا عَنْ قَوَاعِدِ إِبْرَاهِيمَ " . قَالَتْ فَقُلْتُ يَا رَسُولَ اللَّهِ أَفَلاَ تَرُدُّهَا عَلَى قَوَاعِدِ إِبْرَاهِيمَ فَقَالَ رَسُولُ اللَّهِ ﷺ " لَوْلاَ حِدْثَانُ قَوْمِكِ بِالْكُفْرِ لَفَعَلْتُ " . قَالَ فَقَالَ عَبْدُ اللَّهِ بْنُ عُمَرَ لَئِنْ كَانَتْ عَائِشَةُ سَمِعَتْ هَذَا مِنْ رَسُولِ اللَّهِ ﷺ مَا أُرَى رَسُولَ اللَّهِ ﷺ تَرَكَ اسْتِلاَمَ الرُّكْنَيْنِ اللَّذَيْنِ يَلِيَانِ الْحِجْرَ إِلاَّ أَنَّ الْبَيْتَ لَمْ يُتَمَّمْ عَلَى قَوَاعِدِ إِبْرَاهِيمَ .