mdz4040·11 месяцев назад·discuss55 token/s here on m4 pro, turning on flash attention puts it to 60/s.