The Hidden Bloat in Machine Learning Systems(mlsys.org)
mlsys.org
The Hidden Bloat in Machine Learning Systems
https://mlsys.org/virtual/2025/poster/3238
1 comments
The tool claims to reduce the GPU code size by up to 75% and the CPU code by up to 72% for ML workloads, resulting in total file size reductions of up to 55%.They also claim to achieve reductions in peak CPU memory usage, peak GPU memory usage, and execution time by up to 74.6%, 69.6%, and 44.6%. Authors claim they will opensource the tools here: https://github.com/negativa-ai