The 45-year-old musician was up for his second Golden Globe for the Danny Boyle film 127 Hours and had just a day earlier bagged the best original song trophy at the 16th Critics' Choice Awards for his number If I Rise from the film.
The musician, who had won his first Golden Globe in 2009 for Boyle's previous film Slumdog Millionaire, is in the running for his second Oscar with the song, which is a collaboration between him and British popstar Dido.
'A year ago I had no idea I'd have the opportunity to score a film. The idea of standing up here to accept this award is surreal,' said Reznor, who is the frontman of the rock group Nine Inch Nails, in his acceptance speech.
Rahman's music in 127 Hours, starring James Franco as real-life mountain climber Aron Ralston, who cut off his arm to escape from beneath a boulder after being trapped for more than five days, had received good reviews for it's 'haunting tracks' and 'wonderful crescendos.'
The musician, known as the 'Mozart of Madras' had won two Oscars for his score in Slumdog Millionaire at the 2009 Oscars, taking the film's total haul to eight.
His song Na Na from his Hollywood debut venture Couple's Retreat, was longlisted in the Best Original Song category at the 2010 Oscars but failed to win a nomination.
Rahman, who was honoured with a Padma Bhushan last year, had enjoyed a golden run at the 52nd Grammy Awards, where he had again bagged two gramophones for his music in the Slumdog Millionaire.
Golden Globe winners, at a glance
Is this the hottest trend on the red carpet?
Golden Globes 2011: On the Red Carpet
Do these stars get your Fashion vote?