An important caveat is that this is practically and theoretically true for "embarrassingly parallel" (in the term-of-art, not perjorative sense) compute problems, and only if one sets aside supply-chain issues.
It's theoretically (but rarely practically) true for network-bound problems of all sorts.
It's not theoretically (and usually not practically) true for storage-bound problems. (Though Wh/bytes-at-rest is a useful bounding metric to understand if you're trying to build a storage business. It's never zero if the integrity of a byte at rest is at all important. Integrity is complicated.)
But in any case, supply chain issues tend to dominate as the limiting factor at the largest scale in my experience. This has always been true, even since before the current clusterfuck.
It's theoretically (but rarely practically) true for network-bound problems of all sorts.
It's not theoretically (and usually not practically) true for storage-bound problems. (Though Wh/bytes-at-rest is a useful bounding metric to understand if you're trying to build a storage business. It's never zero if the integrity of a byte at rest is at all important. Integrity is complicated.)
But in any case, supply chain issues tend to dominate as the limiting factor at the largest scale in my experience. This has always been true, even since before the current clusterfuck.
Source: no comment.