Saudi-born Adnan Shukrijuma was killed in the Shinwarsak area of South Waziristan tribal district. "His accomplice and local facilitator were also killed in the raid," said a statement by military's Inter Services Public Relations.
The army said Shukrijuma was a member of the core Al Qaeda leadership and was in charge of its global operations. During the raid, a soldier was killed and another injured.
Shukrijuma was among the five men indicted in the US over a plot to bomb New York's subway system under orders from Al Qaeda leaders in Pakistan.
The New York indictment links him to the Manhattan plot and a similar never-executed scheme to attack British subways, according to media reports.
The US has long said that the Saudi native was a threat to America and put $5 million reward for his capture.
In a 2003 report in The Washington Post said Shukrijuma as a possible terrorism organiser in the style of Mohamed Atta, the suspected ringleader of the September 11, 2001, attacks.
Following the killing of Shukrijuma, Chief of Army Staff General Raheel Sharif tweeted that all terrorists would be eliminated from Pakistan's soil. "None will be spared."
Pakistan military spokesman Major General Asim Bajwa tweeted: Top Al Qaeda Comd Adnan Al Shukri Aljuma with his 1 companion killed by Pak Army raid in S Waziristan today." He also tweeted that five "terrorists" were also arrested during the raid.
Shukrijuma had moved to South Waziristan to from North Waziristan Agency due to the ongoing Zarb-i-Azb military operation, the ISPR statement said.
Image: Adnan Shukrijuma was wanted by the US for his role in a 2009 plot to attack the New York subway. Photograph: FBI
The MBA who sold her car to follow her passion
Bombay, Black Friday, Parzania: Top 11 Real to Reel Stories
The illustrious journey of India's 5 best selling cars
'Muslims in India will learn to live as second class citizens'
Shiva secures 25th place in maiden Luge World Cup finals