Minister of State for Communication and Information Technology Sachin Pilot on Monday said that the Congress was contemplating taking legal action against Janata Party president Dr Subramaniam Swamy for making 'allegations' against Prime Minister Manmohan Singh and the Gandhi family on 'flimsy grounds'.

"All the allegations that he has been making in the 2G spectrum case, particularly against the prime minister and others, are totally baseless and unwarranted," he said.

Asked if he felt embarrassed as the 2G scam was related to his ministry, the young Parliamentarian said that he could not be answerable for something that happened in 2007.

"The matter is being investigated by the Central Bureau of Investigation. The case is also being heard in the Supreme court so it would not be proper to say anything on the matter," he said.

Replying to a query on Swamy, Pilot told rediff.com, "He has been attacking Mrs Gandhi's family for last twenty years. The time has come to put an end to his sordid saga. We have asked for legal opinion on the letters written by him to the PM on this matter. He creates problems just to keep himself alive politically. Legal action against Swamy is on the cards."