The Sensex closed for the day at 20,148 down 13 points and the Nifty slipped seven points to end at 6,104.
In broader markets, both the mid and smallcap indices underperformed, losing 0.2-0.4% as compared to the 0.1% loss on the BSE benchmark index.
In international markets, Asian markets had a mixed session. Japan's Nikkei share average inched up in choppy trade on Wednesday, with investors still wary after last week's tumultuous trade raised concerns about the outlook as the market retreats from 5-1/2-year highs.
The index finished up 0.1% at 14,326.
European shares fell across the board as robust U.S. economic data fanned speculation the Federal Reserve may soon begin tapering back its bond-buying programme.
The FTSE 100, CAC and DAX was down 0.9-1.2%.
Back home, the rupee weakened to its lowest in 10 months on Wednesday tracking broad dollar gains versus global and Asian currencies.
The first time the rupee had breached the 56 mark this month was on May 23 when it had touched 56.01 against the greenback.
Among the sectoral indices, Health Care, Consumer Durables, FMCG, Auto and Oil & Gas were the only indices to close in the green, up 0.1-2%.
On the other hand, Realty index slipped 2.5% followed by Metal, Bankex, Power, IT, Capital Goods and PSU indices, down 0.3-1.1%.
The draggers in the realty space were HDIL, Unitech and Indiabulls Real Estate, all down between 4-7%.
Metal names like Sterlite, Tata Steel and Jindal Steel lost some sheen. The stocks were down 2-2.5%.
All the three IT majors- TCS, Infosys and Wipro closed in the negative, having lost 0.3-1%.
Major financial names ICICI Bank, HDFC, SBI, down 1-1.4%, too were in the red ahead of January-March
Sensex ends above 20,000 led by RIL
Markets end lower as L&T Q4 earnings disappoint
Markets end higher on firm global cues, ITC leads
How Cyrus Mistry is RESHAPING the Tata empire
Rupee up 16 paise at 54.22 on dollar selling