firefly2000

5 か月前議論

Do you think it can be done by adjusting GC aggressiveness (or even disabling it for short periods of time) and correlating it with execution time?

firefly2000

5 か月前議論

Are there plans to elucidate implicit GC costs as well?

firefly2000

5 か月前議論

I have a question about what "validation" means exactly. Does this process work by having the main model compute the "probability" that it would generate the draft sequence, then probabilistically accepting the draft? Wondering if there is a better method that preserves the distribution of the main model.

firefly2000

5 か月前議論

If the workload were perfectly parallelizable, your claim would be true. However, if it has serial dependency chains, it is absolutely worth it to compute it quickly and unreliably and verify in parallel

firefly2000

5 か月前議論

Does the lack of forward progress guarantees (ITS) on other architectures pose challenges for async/await?

firefly2000

5 か月前議論

Is this Nvidia-only or does it work on other architectures?

コメント