Mario Goetze nodded Germany ahead in the 51st minute, but Ghana instantly roared into attack. Andre Ayew headed an excellent equalizer three minutes later, and the Ghanaians went ahead when a great interception and pass by Sulley Muntari set up Asamoah Gyan to lash home in the 63rd.
Germany leveled in the 71st minute with a sharp finish by Klose as the substitute claimed his 15th World Cup goal to move level with former Brazil striker Ronaldo as the tournament's all-time leading scorer.
Germany, who crushed Portugal 4-0 in their opening game, have four points. The United States have three, Ghana one and Portugal zero ahead of their Group G game against the US on Sunday.
- Complete coverage of the football World Cup
Image: Miroslav Klose celebrates after scoring Germany's second goal.
Photograph: Martin Rose/Getty Images
FIFA World Cup: Best Fan of the Day
How Latin American teams are taking a grip on World Cup
In Colombia, forgetting Pablo Escobar
World Cup: Klose inching towards breaking Ronaldo's record but it may have to wait...
Points Table: Football World Cup 2014