Speaking at the inauguration of Dr. Ambedkar National Memorial at 26 Alipur Road, New Delhi, Modi said: "Such incidents shake our sensibilities and cannot be part of a civilised society."
"It's an insult to the freedom fighters who gave their lives for the Independence of this country. We are all ashamed as a society, as a country," Modi said after a nationwide outrage over the incidents in Jammu and Kashmir's Kathua and Unnao in Uttar Pradesh.
"Such incidents in any part of the country or a state shake our humanity. I want to assure the country that no culprit will escape. Justice will be done and it will be complete justice. The daughters will get justice. We all will have to join and remove this evil from the society," Modi said.
Earlier on Friday, Congress President Rahul Gandhi slammed Modi for maintaining silence over the "growing violence against women and children" in the country.
Rahul, who led a midnight march to India Gate on Thursday to protest the Kathua and Unnao minor rape cases, said Modi's silence on these incidents is unacceptable and urged the prime minister to "speak up".
He asked Modi what does he "think about the growing violence against women and children" and why are the "accused rapists and murderers protected by the state".
"India is waiting, speak up," he wrote on Twitter.