I think the only notifications i care about are steam notifications. Otherwise, i aggressively turn them off. I expect myself to catch up on an application when I use the application.
Maybe the only downside is checking my calendar, email, IM at least once a day instead of letting it inform me of events.