Yadav also likened Sonia Gandhi and Rahul Gandhi to Hitler.
Congress state president Ashok Choudhary said the party has suspended Sadhu Yadav from the party for six years for meeting and praising Modi.
"Congress suspended him as he crossed the party line and challenged party's stand on Modi," he said.
Modi on last Friday invited Sadhu Yadav, the controversial Congress leader and brother-in-law of Rashtriya Janata Dal chief Lalu Prasad, for tea and held a meeting with him for 45 minutes.
Bihar BJP leaders including former deputy chief minister Sushil Modi has opposed any move to take Sadhu Yadav into the BJP fold.
Lalu's brother-in-law Sadhu Yadav meets Modi in Ahmedabad
Do voters like Narendra Modi?
'Telangana must not become a prisoner of provincialism, xenophobia, strife'
Digvijay calls Modi fascist, slams 'Congress Mukt Bharat' pitch
Arun Nehru cremated, Priyanka's son lights the pyre