Narrated 'Aisha:

(the wife of the Prophet) that Allah's Apostle ﷺ said to her, "Do you know that when your people (Quraish) rebuilt the Ka'ba, they decreased it from its original foundation laid by Abraham?" I said, "O Allah's Apostle! Why don't you rebuild it on its original foundation laid by Abraham?" He replied, "Were it not for the fact that your people are close to the pre-lslamic Period of ignorance (i.e. they have recently become Muslims) I would have done so." The sub-narrator, 'Abdullah (bin 'Umar ) stated: 'Aisha 'must have heard this from Allah's Apostle for in my opinion Allah's Apostle had not placed his hand over the two corners of the Ka'ba opposite Al-Hijr only because the Ka'ba was not rebuilt on its original foundations laid by Abraham.

حَدَّثَنَا عَبْدُ اللَّهِ بْنُ مَسْلَمَةَ، عَنْ مَالِكٍ، عَنِ ابْنِ شِهَابٍ، عَنْ سَالِمِ بْنِ عَبْدِ اللَّهِ، أَنَّ عَبْدَ اللَّهِ بْنَ مُحَمَّدِ بْنِ أَبِي بَكْرٍ، أَخْبَرَ عَبْدَ اللَّهِ بْنَ عُمَرَ، عَنْ عَائِشَةَ ـ رضى الله عنهم ـ زَوْجِ النَّبِيِّ ﷺ أَنَّ رَسُولَ اللَّهِ ﷺ قَالَ لَهَا " أَلَمْ تَرَىْ أَنَّ قَوْمَكِ لَمَّا بَنَوُا الْكَعْبَةَ اقْتَصَرُوا عَنْ قَوَاعِدِ إِبْرَاهِيمَ ". فَقُلْتُ يَا رَسُولَ اللَّهِ أَلاَ تَرُدُّهَا عَلَى قَوَاعِدِ إِبْرَاهِيمَ. قَالَ " لَوْلاَ حِدْثَانُ قَوْمِكِ بِالْكُفْرِ لَفَعَلْتُ ". فَقَالَ عَبْدُ اللَّهِ ـ رضى الله عنه ـ لَئِنْ كَانَتْ عَائِشَةُ ـ رضى الله عنها ـ سَمِعَتْ هَذَا مِنْ رَسُولِ اللَّهِ ﷺ مَا أُرَى رَسُولَ اللَّهِ ﷺ تَرَكَ اسْتِلاَمَ الرُّكْنَيْنِ اللَّذَيْنِ يَلِيَانِ الْحِجْرَ، إِلاَّ أَنَّ الْبَيْتَ لَمْ يُتَمَّمْ عَلَى قَوَاعِدِ إِبْرَاهِيمَ.