The Congress on Monday attacked Prime Minister Narendra Modi for his controversial "graveyard and cremation ground", remark alleging him of "vitiating" the atmosphere during the state polls.