But for many years, architecture buffs have made a pilgrimage to this Connecticut coastal town for its modernist buildings. “Anyone who lives on the Eastern Seaboard and has driven up I-95 knows ...