The policemen, identified as constables Vikram Singh and Jitendra Yadav, were arrested from the city.
Last week, police had arrested Sub-Inspector Pradhyuman Yadav who led the team of Haryana police that killed Gadoli in an encounter at Hotel Airport Metro here on February 7.
Gadoli's family had moved the Bombay High Court alleging that it was a fake encounter, following which Mumbai police had started a probe.
Earlier, a sub-inspector of Gurgaon police was also arrested by a Special Investigation Team of Mumbai police in connection with the alleged fake encounter of suspected gangster Sandeep Gadoli in Andheri.
Pradhuman Yadav, Sub-Inspector of Gurgaon Police, was arrested in a raid conducted at his house last night at Old Gurgaon, Sanjay Saxena, Joint Commissioner of Mumbai Police, Crime Branch said, adding, more people are likely to be apprehended.
Two Special Investigation Teams (SIT) of Mumbai police Crime Branch, camping in two hotels at Mahipalpur and old Gurgaon in Rajokari area from March 27, were monitoring the activities of Yadav, who was changing his location to escape arrest, Saxena said.
Acting on a tip-off that Yadav was hiding in a house in Old Gurgaon, the teams raided the premised and arrested him.
"We have arrested him on charges of murder, attempt to murder, Arms Act, criminal conspiracy and destruction of evidence," the Joint Commissioner of Mumbai police said.