HackerTrans
トップ新着トレンドコメント過去質問紹介求人

gdcohen

no profile record

投稿

Decoding GPU Efficiency: The FLOPs Fallacy

clockwork.io
3 ポイント·投稿者 gdcohen·4 か月前·0 コメント

コメント

gdcohen
·4 か月前·議論
I agree. If you can reliably recover from failures by migrating instead of restoring from checkpoints, then the need to checkpoint frequently becomes far less important and reduces the overhead of taking checkpoints. Similarly, a lot of users are experimenting with asynchronous checkpoints to reduce the blocking penalty, but there are big tradeoffs there with DRAM usage. So being able to take checkpoints far less frequently gives you more flexibility on the type of checkpointing you use as well.
gdcohen
·7 か月前·議論
Take a look at Exploiting a Natural Network Effect for Scalable, Fine-grained Clock Synchronization - https://www.usenix.org/conference/nsdi18/presentation/geng (commercial version by the same authors - clockwork.io).