The president had several tense exchanges with the press over the weekend, including pointing in the face of a female reporter