He said that people should have the right to choose what they believe is correct and still be tolerant of others' ideas in a democracy.
"Today nationalism is decided by whether or not one can say 'Bharat Mata Ki Jai'. I am happy to say it, but should I also oblige everyone to say it?
"Our Constitution gives people the right not to say it just as it gives people the right to say it as well. I will choose when to say it and that's democracy," Tharoor said addressing students at the JNU.
Tharoor said our country is not just 'Hindi, Hindu and Hindustan' and called for an India 'more accepting of diversity' which he said has been the tradition throughout history.
"India is not just Hindi, Hindu and Hindustan. We want an India with both Krishna and Kanhaiya Kumar. We want in India people from every corner of this vast land an equal stake in our future.
"If we understand that the Indian civilisation allows many religions, celebrates range of opinions and is today sustained by constitutional democracy which stands for certain values that all of us claim as our own, if this is the Indian legacy we can live, then we can all stand under that flag and celebrate," he said.
Tharoor was speaking on 'JNU and Nationalism' outside the administrative hall of the varsity which has been the centre of protests ever since sedition charges were slapped on three students over an event where anti-national slogans were allegedly raised.
Tharoor appreciated the students for stirring a debate on vital issues in India, saying student days are the days "to expand one's consciousness".
"You may have come here for education but you are also educating the nation. What is happening here has given the whole nation an education in the vital issues of dissent and democracy, sedition and of course of 'azaadi' (freedom)," he said.
Tharoor's nearly 40-minute long speech was dotted with historical anecdotes and personal experiences and he repeatedly quoted personalities like Jawaharlal Nehru and Everlyn Beatrice Hall to drive home the idea of tolerance and diversity and their importance in India.
Earlier in the day, Jawaharlal Nehru University Student's Union president Kanhaiya Kumar had said that the fight of JNU students was "not against the country but for the country," and had accused the BJP of diverting from "real issues".
"We will protest if the election is fought on the issue of nationalism, we will protest if the real issues are sidelined. We will remind you... to face the real issues of this nation, the issues of poverty, dalits, farmers and other marginalised sections of the Indian society," he said.
On the allegation that JNU students overstay their time in the university, Kanhaiya cited the importance of research in nation building and said it was on par with those of soldiers, farmers and industrialists.
"Research is as important for a nation as the sacrifices of farmers and soldiers. If we don't think, we won't speak and the entire fight is about thinking and speaking," he said.
Before the lectures, a letter, purportedly "from Rohith Vemula" to the Indian President "demanding justice" was circulated among JNU students.
Image: Shashi Tharoor addresses students at JNU. Photograph: Shashi Tharoor/Twitter
Tharoor cites 'intolerance' in BJP as bill on homosexuality voted out
8 lessons from Tharoor's electrifying Oxford speech
The MP who gave the best speech on the JNU row
'My nationalism is not going to be defined by Modi or the State'
Constitution can't be 'doctored', nationalism can't be 'patented': Kanhaiya