The landslide occurred near Gate No. 3 of Mata Vaishno Devi Bhawan and the debris fell on a shelter where the pilgrims were sitting.
"Death is likely to go up as many pilgrims are feared buried under the debris," police said.
A head constable of the CRPF has been confirmed dead due to it. The constable was assisting the pilgrims bound for the shrine when a a huge rock fell on a shelter.
The dead has been identified as head constable Harbinger Singh of 6 Battalion of CRPF, a native of Hoshiarpur in Punjab.
J&K Police, Shrine board team and CRPF have reached the accident site and rescue operation has started as many people are feared trapped under the rubble.
Yatra to the holy cave shrine of Mata Vaishnodevi has been suspended for now.
"Landslide hits Mata Vaishno Devi Bhawan (J&K), one head constable of CRPF dead (confirmed by IG CRPF)," reported news agency ANI.
Earlier this month, four persons including three pilgrims were killed and nine injured in a landslide triggered by heavy rains enroute to the cave shrine of Mata Vaishnodevi in Reasi district.
(More details awaited)