Should GPUs Make Free Trade Agreements?(doubleword.ai)

3 pointsby mezarkhace 10 meses1 comments

https://www.doubleword.ai/resources/should-gpus-make-free-trade-agreements

1 comments

mezarkhace 10 meses

We look at how comparative advantage from economics applies to LLM inference - some GPUs are relatively better at FLOPs, others at memory bandwidth. What happens if you let each do what it’s best at?