Abu Shagur has been forced to stand down after the national congress rejected his second proposed cabinet line-up. His first list of 29 ministers was rejected for not being diverse enough.
His second one, a shorter list submitted on Sunday, was also rejected by lawmakers, who voted 125 to 44 in favour of removing him.
Lawmakers now have three to four weeks to elect a new premier.
Abu Shagur was elected by the assembly last month but he struggled to form a government which satisfied all factions in parliament.
Image: Mustafa Abu Shagur
Photograph: Reuters
Samuels reveals lucky neckerchief after scripting win
US economy: Obama is CLUELESS, Romney CONFUSED
Mahatma Gandhi: What we MUST learn from his life
India, Pak can settle Kashmir issue on their own: Russia
Hamilton gets himself all in a twitter with Button