Inflation remains the priority for Fed officials speaking in Phoenix at a bankers conference. Jobs and the potential for surprises also are concerns.