"I have not read the book but whatever I have heard from friends, I can say that this is all baseless. When they say that all the important government files were routed through her, it is all baseless," he said.
"I am a member of the Core Group Committee. If any member of the Cabinet says that (the files were shown to Gandhi), I will leave the public life," Patel said in an interview to Times Now.
In his book "Accidental Prime Minister -- The Making and Unmaking of Manmohan Singh", Baru has claimed that Prime Minister's principal secretary Pulok Chatterjee would seek "instructions" from Sonia Gandhi on important PMO decisions.
Asked about statements by BJP leaders to probe scams during Congress regime and having an accountability commission, Patel said, "Let them do it. We are not afraid of anybody. We have faced it in the past also...They have gone to the extent that they even included the name of Rajiv Gandhi into the FIR."
He also said that "first of all, they are not going to come to power, and even if they come to power, we are not afraid as we have not done anything wrong."
Patel also came out in defence of Congress Vice President, Rahul Gandhi saying he had not carried out any personal attack against BJP Prime Ministerial candidate Narendra Modi.
BJP releases video, booklet to target Vadra
'How will Mulayam handle nation when he can't handle UP?'
Meeting at Ahmed Patel's home for transfer of officials: Mamata
Is Dr Singh writing his memoirs?
Cong trying to hide in the bunker of secularism: Modi