This ideology is what gets people in trouble with the tax authorities of their resident country... talk to an accountant and watch them laugh you out the door.
Even if you incorporate in say Delaware, if you are physically present running your business in New York you must register your LLC there (Authority to Transact Business) which comes with the same requirements.