kilnr·vor 3 Jahren·discussI get about the same speed (35 tok/s) out of 13B Llama2 on a 4070 Ti, FWIW.
kilnr·vor 3 Jahren·discussuBlock is great for this sort of stuff. I also use it to hide the Hot Network Questions on Stack Overflow. I often get distracted by those.