Watford have been unsuccessful in their appeal of Vakoun Bayo's red card, but Tom Cleverley remains annoyed at the decision.