Congress' Shashi Tharoor has alleged that leaders and parties are playing vote bank politics over India's sensitive issue - intolerance.