Yeah, and you might get into a funk and decide to just hit it really hard one time and then you are pretty much back where you started. I found cold turkey worked best.
I found just cutting it out to work best rather than wean off if it. It sucks for about a week, but overall quiting caffeine was harder. Just don't have any lying around and don't go to the store to buy more. I had trouble sleeping for a few days, I was kinda irritable but it wore off pretty quick.