The group expressed concern that "a special community" has almost always been "targeted" in the aftermaths of terrorist attacks in the country and investigating agencies had failed to perform their duties well.
They pointed out that many of the people arrested in the name of terrorism from different parts of the country had later been acquitted by the courts. They demanded that trials of people accused of terrorism be "fast tracked" and the innocent be released.
"Innocent people... are still (languishing) in many lock ups and a number of them, despite have been acquitted from the courts, are yet to be released," said their memorandum.
The delegation said there was also need to confront the mindset of accusing "a special community" after incidents of terrorism occur.
Darul Uloom had in 2008 issued a fatwa denouncing acts of terror and had condemned the targeting of innocent people.
Has Taliban pulled out of the peace deal in Pakistan?
A dismal third anniversary for UPA-2
PM hapless, UPA regime most corrupt, inefficient: Advani
Egypt polls: Muslim Brotherhood heading towards victory
The agenda for Dr Singh's historic Myanmar visit