"No, I am not," he retorted when asked by reporters whether he was resigning from the post as he stepped out of his office which he had not attended for the past three days.
Earlier, he said he would do whatever he has to.
"I will not answer any question of yours. I will do whatever I have to," said an angry Ganguly, who has been indicted by a Supreme Court panel following a complaint of sexual harassment by a law intern, when reporters shot questions at him while he was taking a morning walk.
Trinamool Congress MP Derek O'Brien tweeted "Today is United Nations Human Rights Day. Former Supreme Court judge Ashok Ganguly is continuing as chief of WBHRC. Sir, please don't mock your office."
Many politicians, including West Bengal Chief Minister Mamata Banerjee has sought action against him.
Banerjee has twice written to President Pranab Mukherjee asking him to take appropriate action urgently.
Ganguly, who retired from the apex court more than a year ago, was accused by the law intern of sexually harassing her in a hotel room in Delhi last year. The judge strongly denied the charge.
Uncertainty over Lalit Modi contesting RCA elections
Delhi Police asks law intern to record statement
Public has already expressed no-confidence against Centre: Mamata
Sebi did not use Sahara money for own expenses: Govt
Justice Ganguly case: Delhi police asks law intern to register complaint