The BSE benchmark index, Sensex closed down 101 points at 18,394.
Of the total 101 points shed by the Sensex on Wednesday, heavwieghts Reliance, HDFC, ONGC and Infosys accounted for a loss of 61 points.
The NSE Nifty settled with a loss of 29 points at 5,526.
The broader markets, however, held ground in the downfall.
The smallcap index closed up 0.2% at 8,319 while the midcap index was flat at 6,929, both outperfroming the Sensex which was down 0.5%.
This is the second consecutive day when the broader markets have exhibited stength.
Earlier in the day, the markets opened lower tracking weak Asian peers after US Federal Reserve Chairman Ben Bernanke's statement that US economy was growing very slowly.
Thereafter, key benchmark indices rebounded into the positive zone for a brief while, with the Sensex touching a high of 18,505.
However, due to the weakness in index index heavyweights RIL and ONGC the markets slipped and dropped sharply in the afternoon trades to touch a low of 18,366, down 139 points from the day's high.
Weak opening in the European markets further dampened the sentiment.
Amid apprehensions of a moderation in economic growth from the projected 9% this fiscal, Finance Secretary Sunil Mitra on Wednesday said the revenue collection targets for the current fiscal will not be easy to achieve.
The government has set the indirect tax collection target for the current fiscal at Rs 3.92 lakh crore and for direct taxes at Rs 5.32 lakh crore.
Meanwhile at Citi investor conference, deputy governor of the Reserve Bank of India
Bulls back to fore, Sensex surges 434 pts
Big deal! P&G keen to gobble up Unilever for $62 bn
50% IPOs trading below issue price
Home loans: IndusInd Bank inks MoU with HDFC
SC notice to Indiabulls over SEBI plea