Beyond malloc efficiency to fleet efficiency(cloud.google.com)
cloud.google.com
Beyond malloc efficiency to fleet efficiency
https://cloud.google.com/blog/topics/systems/trading-off-malloc-costs-and-fleet-efficiency
4 comments
Agreed. Microbenchmarking can be detrimental if you don't verify with some 'macro' benchmarking with realistic use cases.
And tracking the right metrics!
And tracking the right metrics!
> In Google’s data centers, this improvement reduced TLB stalls by 6% and memory fragmentation by 26%.
Yet after Ctr+F-ing the paper for the term, I have yet to find an accurate definition of "fragmentation". Keeping in mind that fragmentation is an allocator's major enemy, it bugs me to realize that there is no universally agreed-upon formulation yet.
Does anyone more knowledgeable have a more informed opinion on the matter?
Yet after Ctr+F-ing the paper for the term, I have yet to find an accurate definition of "fragmentation". Keeping in mind that fragmentation is an allocator's major enemy, it bugs me to realize that there is no universally agreed-upon formulation yet.
Does anyone more knowledgeable have a more informed opinion on the matter?
Seems like a bit of a tragedy of the commons. Individual containers benefit from a faster malloc, but the whole fleet benefits from one doing more work.
This is the stuff of performance nightmares. Anyone thinking about optimization often will get single-tracked into the performance regression there and maybe not necessarily see the improved overall performance (requests per second).