From Caitanya Caritamrita
When Lord Caitanya saw Govardhana Hill, He immediately offered obeisances, falling down on the ground like a rod. He embraced one piece of rock from Govardhana Hill and became mad.
Just by seeing Govardhana Hill, Sri Caitanya Mahaprabhu became ecstatic with love of Krishna. While dancing and dancing and dancing, He recited the following verse from the Srimad Bhagavatam:
"Of all the devotees, this Govardhana Hill is the best! O My friends, this hill supplies Krishna and Balarama as well as Their calves, cows and cowherd friends with all kinds of necessities water for drinking, very soft grass, fruits, flowers and vegetables. In this way the hill offers respect to the Lord. Being touched by the lotus feet of Krishna and Balarama, Govardhana Hill appears very jubilant."
Lord Caitanya first bathed in Manasi Ganga and then took darshan of Harideva before doing Govardhana parikrama.
Lord Caitanya instructed: "One should remain in Vrindavana for only a short time and then return here as soon as possible. Also, do not climb Govardhana Hill to see the Gopala Deity."
Govardhana Shilas Devotees take rocks from Govardhana Hill and worship them exactly as they worship the Deity of Krishna in the temple. This worship is as good as Deity worship. Lord Krishna has appeared as Govardhana-shila (a stone from the hill), so that His devotees may render service to Him. It is important that not just anyone takes a rock from Govardhana Hill. The night to worship a Govardhana-shila should be given only by the guru (spiritual master). So his permission should be taken before beginning worship.