The conservative firebrand, who is retiring from Congress early, and the president are engaged in bitter falling-out.