"I have come here with a message of love for the Pakistani people as both countries want to have peace, stability and progress in the region," he said.
To a question posed by a reporter, Kumar said in a light-hearted manner that a person only invites someone to his home for whom he has love in his heart. "... And a person only goes to that place or house for whom he has love in his heart," he added.
The Bihar CM had received praise for his good governance from Pakistan's cricketer-turned-politician, Imran Khan, who recently attended the World Economic Forum in Gurgaon.
High-profile security arrangements were put in place for Kumar and his delegation, with his motorcade guided by para-military rangers and elite police commandos. Kumar will return to India via the Wagah border.
In 2003, Rashtriya Janata Dal chief Lalu Prasad had also visited Pakistan and his trademark humour made him hugely popular.
A Pakistani delegation, which had visited Bihar in August, had extended an invitation to Kumar on behalf of Punjab Chief Minister Mohammad Shahwaz Sharif.
Sohrab case: Amit Shah, 7 others appear in Mumbai court
In Bihar, it's Big B versus Maoists
Nawaz Sharif's PML-N most popular party in Pak: Survey
15 injured in Pakistan blast
Nitish Kumar likely to meet Zardari during Pak visit