"I want to assure the nation that the security forces are giving befitting reply to the firing from Pakistan. We will not bow down before anyone," he told reporters.
Singh said if countrymen were celebrating Diwali, it was because of the security personnel guarding the borders.
The home minister said people must have faith in security forces who are foiling the evil designs of enemies.
Terrorists, aided by the cover fire by Pakistani Army, on Friday night crossed the Line of Control in Jammu and Kashmir and killed an Indian Army jawan and mutilated his body, prompting the army to warn that the "incident will be responded to appropriately."
Four army and three BSF personnel have died in the latest escalation along the boundary with Pakistan in Jammu and Kashmir.
Pakistan Rangers also violated ceasefire in RS Pura and Kathua sectors along International Border on Saturday.
Photograph: ANI
Pakistan threat: The next month will be most dangerous
India's terrorism narrative needs a rethink
How do you solve a problem like Pakistan?
Why containment of Pakistan is better than war
Former R&AW chief: How we can fix the Pak problem