Yes, you're exactly right. I think one of the reasons a lot of people get anxious and scared about death is because they think that when they die they're going to be locked up in a dark room forever... but you won't, because non-existence is not an experience. As Alan Watts put it, death will be just like going to sleep and never waking up, just as being born was waking up never having gone to sleep.