The Headless Horseman is synonymous with Washington Irving ... The soldier was supposedly buried in an unmarked grave at Old Dutch Church, which would be featured in Irving’s tale.