Laguna XS 2.1 33B on a RTX 3090: 296 tok/s peak, 152 tok/s at 256K context(lucebox.com)
lucebox.com
Laguna XS 2.1 33B on a RTX 3090: 296 tok/s peak, 152 tok/s at 256K context
https://www.lucebox.com/blog/laguna-xs21
https://www.lucebox.com/blog/laguna-xs21
Anyone compare with the club-3090 dual setup?