The problem with limiting Slack to mentions is that it incentivizes colleagues to @-mention you just for visibility, which quickly defeats the purpose of the filter.
Use ThreadPatrol to automate thread enforcement, which keeps channel noise down and makes those selective notifications actually meaningful: https://thread-patrol.com
I built ThreadPatrol to help exactly with that: https://thread-patrol.com/