The Following is taken from Tafseer Ibn Kathir
Allah encouraged His Prophet to pray in Masjid Quba' which, from the first day, was built on Taqwa, obedience to Allah and His Messenger , for gathering the word of the believers and as an outpost and a fort for Islam and its people. This is why Allah the Exalted said,
(Verily, the Masjid whose foundation was laid from the first day on Taqwa is more worthy that you stand therein (to pray).) in reference to the Masjid of Quba'.
An authentic Hadith records that the Messenger of Allah said,
(One prayer in Masjid Quba' is just like an `Umrah.)
It is recorded in the Sahih that the Messenger of Allah used to visit Masjid Quba' while riding and walking.
[ Taken from Etiquettes of Ziyaarah - by Imâm al-Madîna al-Munawarrah Salâh al-Budayr ]
It is prescribed for the visitor to Madeenah and for the one who lives there to go to the Mosque of Quba’ and pray there, following the example of the Prophet (peace and blessings of Allaah be upon him) and seeking the reward of ‘Umrah. It was narrated that Sahl ibn Haneef said: The Messenger of Allaah (peace and blessings of Allaah be upon him) said: “Whoever goes out until he comes to this mosque – meaning the Mosque of Quba’ – and prays there, that will be equivalent to ‘Umrah.” Narrated by Ahmad, 3/437; al-Nasaa’i, 699; classed as saheeh by al-Albaani in Saheeh al-Targheeb, 1180, 1181.
According to Ibn Maajah: “Whoever purifies himself in his house, then comes to the Mosque of Quba’ and prays there, he will have the reward of ‘Umrah.” Narrated by Ibn Maajah, 1412.
In Sahih Muslim it is narrated that the Messenger of Allaah (peace and blessings of Allaah be upon him) used to go to the mosque of Quba’ every Saturday, walking or riding, and he would pray two rak’ahs there. Narrated by al-Bukhaari, 1191; Muslim, 1399