"The entire country knows that the Prime Minister is neither dictatorial, nor communal. If he had been dictatorial or communal, then I think people of such a huge country would not have given such a mandate that for the first time in the history of independent India, a non Congress political party has a clear mandate in Parliament," Singh told reporters outside Parliament.
He was also asked a question related to Gandhi's charge of "partiality" in the Lok Sabha and discussion not being allowed.
"This is a matter related to the House, and I think if any congnisance has to be taken, the Speaker will do it," Singh said.
The Congress vice president had earlier in the day stormed the Well in the Lok Sabha, demanding a debate on communal tension, accusing the Modi government of not allowing discussion in Parliament where he said only one man's voice is heard.
"We are not being allowed to speak in Parliament. We are asking for discussion. There is a mentality in the government that discussion is not acceptable. Everybody feels it, their party feels it, we feel it, everybody feels it," he said.
Even the government on Wednesday attacked the Congress for creating an uproar in Parliament, saying such behaviour would "boomerang" on it and that the party should reconcile to its defeat and play a constructive role.
Parliamentary Affairs Minister Venkaiah Naidu also disapproved of the allegations levelled by the Opposition against the Speaker, saying such actions were only "pressure tactics".
"I don't want to take any names but as a parliamentary affairs minister, the way the major opposition party is behaving in Parliament, I am pained by it," he told reporters outside Parliament.
Congress along with other opposition parties created uproar in Lok Sabha today while demanding urgent discussion on the communal situation in the country.
Naidu said when Parliament is functioning, it is wrong not to allow the House to function, seeking an adjournment.
"More than 450 members want to ask questions, they are eagerly waiting for an opportunity and have done their homework. Ministers are also willing to give answers. You (opposition) don't allow them. You obstruct them and then call us dictatorial," the minister said.
"And you use all names against the Prime Minister...You say the Prime Minister ran away. The Prime Minister was sitting all the time. You did not have the patience to ask questions. After this situation, when the PM did not want to see this situation, he has got work and went away...Then also taking PM's name and trying to provoke ruling members so that something happens, this is not good," he said.
Naidu said the people have given a massive mandate for the government and Congress should come to terms with it.
"Please understand the reality of the situation. Please reconcile, to the defeat, be constructive. And then take every opportunity. Let us join together and discuss people's issues, this is my appeal to the Congress," he said.
He also termed any allegation directed at the Speaker as "unfair pressure tactic".
"It is not fair to make allegations against the Speaker, I feel these are all pressure tactics. Please don't adopt pressure tactics against the Speaker. Speaker is the presiding oficer of the House," Naidu said, adding the attitude of the Congress would "boomerang" on the party.
The Parliamentary Affairs Minister said an adjournment motion is given if something all of a sudden happens and if it is very serious in nature.
"You give a motion for adjournment and it will be decided by the Speaker. The Speaker said 'I am not allowing the adjournment motion' but still the Congress which is supposed to be the senior party according to them, and which has been in power for 50 years and continuously in the last ten years protested.
"And if they obstruct the House, what will happen to Parliament, what will happen to democracy. They should introspect on this," he said.
The Congress Vice President had entered the Well for first time to join his party members in demanding an adjournment motion on the communal violence issue which was opposed by the government.
Image: Home Minister Rajnath Singh and Congress vice president Rahul Gandhi
Working to set up rape crises centers in every district: Maneka
How TMC's Sudip Bandyopadhyay put govt on the mat
Vasundhara Raje's 'Rajasthan Model' set to be a success
Centre raises alarm after Bihar's Kosi threatens to flood
Sikh rights group seeks info on Obama's decision to invite PM