The comedian opened up about being “harassed for like five years” after the public became interested in his love life.