I use the SmartTube frontend on my TV and do not have it linked to my Google account for exactly this reason. I just leave it set as the default user.
Yes, it's a bit of a pain if I find a channel that I would like to subscribe to, that I need to do it twice (once on the TV, once in YT on my phone), but that's a very hurdle.