"Faces of women in burqa are not being checked and I allege that fake voting is taking place," he told reporters here.
He also said that he will demand a re-poll if his concerns were not addressed.
Additional Chief Election Officer B.R. Tiwari said that if a woman was in a veil, there were women officials who identify them and only then they are allowed to cast their vote, told news agency IANS.
The former Minister is seeking re-election from the constituency and is being challenged by Rashtriya Lok Dal chief Ajit Singh in Muzaffarnagar.
Ajit Singh countered that everything was going on smoothly. "Baliyan is used to speaking nonsense."
Former UP CM Akhilesh Yadav also said “those losing elections usually come up with such claims. Ajit Singh is clearly going to win the seat.”
Muzaffarnagar, one of the most communally sensitive constituencies in Uttar Pradesh, gained notoriety in the aftermath of the communal riots in 2013.
Muslims constitute the single biggest electorate in the constituency. The Dalit community has the second biggest chunk of voters. Jats, who dominate the landscape of western Uttar Pradesh, are also influential in the constituency.
In the other communally sensitive region of Kairna, a BSF personnel fired in the air at a polling booth as some people, who were not carrying their identity cards, tried to forcibly enter the premises to cast their votes. The incident took place at a polling booth in Rasoolpur Gujran village under Kandhla police station around 12 pm.
Some people, who had turned up without their identity cards, tried to enter the polling booth forcibly. Pushing and shoving ensued when the presiding officer tried to stop them, Superintendent of Police, Shamli, Ajay Kumar was quoted as saying by news agency PTI. To bring the situation under control, BSF personnel at the booth fired in the air, which led to chaos. Later police personnel also reached the spot, he said. The situation is normal now and polling is underway smoothly, the SP added.