New York City - Waypoint, Day Trip, or Destination

Every time we drove north from Maryland to New England we had to pass through New York. Sometimes we took a ship from there to Europe, sometimes we took a plane, and sometimes we just visited the city