living in manhattan can also be choosing to be closer to customers (existing and potential), closer to potential talent, closer to startup events, closer to angels, closer to VCs, closer to conferences and closer to the universities.
Sure, NJ is cheaper but it's a lot easier to have coffee with people if doing so doesn't involve an hour round-trip commute.