Academy and Jazz Record Centers are the two best places to visit in Manhattan for vintage vinyl, in my experience. There are a couple of places on Bleecker Street which sell vinyl (good for killing a few minutes while waiting to attend a jazz concert on Seventh Avenue and vicinity), but their prices are not reasonable.