Zardari, who made a telephone call to Gandhi to condemn the coordinated terrorist attacks in Mumbai that left over 100 people dead and many more injured, said the killing of innocent people was "most detestable".
A statement issued by the presidency said Zardari "condemned the attacks in the strongest possible terms".
He said "militancy and extremism in all forms and manifestations had to be eliminated" and countries needed to cooperate with one another in this regard.
Zardari asked Gandhi to convey his condolences and those of the people of Pakistan to the members of the victims' families.
Foreign Minister Shah Mahmood Qureshi, currently on an official visit to India, said Pakistan and India need "to be calm, composed and supportive of each other" instead of making "knee-jerk reactions".
"We have to pool our resources and we have to join hands to fight and combat terrorism and extremism," he told Dawn News TV.
Exclusive: Lashkar terrorist Ismail arrested in Mumbai
The funerals have begun
Pall of gloom at ATS chief Karkare's home
Terrorists came in boats: Home ministry
Nine foreigners killed in Mumbai terror attacks