This can happen if the gap around the electrical box is too big, giving the device's mounting straps very little wall to grab. The gap around the box's perimeter should be 1/8 inch or less— if ...

Exterior surface-mount boxes—often molded PVC—have either threaded or glued hubs and are used with PVC electrical conduit ...