New Jersey's Feltville Historic District is actually located in Berkeley Heights in Union County. The district includes eight houses, a church, a carriage house and a general house. Over the years, Feltville has served as a mill town, a farming community and a summer resort.
These days, visitors stroll through the district, which is open every day. A visitor center is open on Saturdays and Sundays where you can pick up a map of the area. The district is not totally uninhabited, but it is locally known as the "Deserted Village" so if you go, anticipate spookiness.
Here's a page on the Union County website all about the Feltville Historic District.
And here's a video that the Weird NJ Adventure Vlog shot in Feltville last Spring: