The dollar drifted higher on Friday, following small losses a day earlier, as traders grappled with the outlook for the U.S.