It has appointed Subhas DeGamia, a veteran with ANZ in institutional banking and financial markets, as chief executive of its India operations.
ANZ had exited from India in 2000 after it sold its Grindlays Bank unit to Standard Chartered Plc.
After deciding to return, it received Reserve Bank of India's approval for a banking licence in October 2010.
The bank has a technology and back office processing centre in Bangalore, which employs around 5,000 people.
"The opening of the Mumbai branch re-establishes ANZ's banking presence in India...India is an integral part of our super-regional strategy," said Alex Thursby, chief executive of the bank's businesses in the Asia Pacific, Europe and America.
The Mumbai branch will initially support corporate and institutional banking clients in India and ANZ's clients abroad
India blank NZ 2-0 in Jr Davis Cup
360,000 cards hacked in May cyber attack: Citigroup
Housing prices may rise by up to 10%
Made in heaven, unmade on the Web
'World Cup should be for the premium sides'