Voyager and Celsius bankruptcies destroyed investor confidencemarketwatch.com1 ポイント·投稿者 mauricio·4 年前·1 コメント
mauricio·2 か月前·議論Looking back at this, has there been a maverick company like Nullsoft since then? It's sad, but AOL may have killed off the last one.
mauricio·2 年前·議論22B params * 2 bytes (FP16) = 44GB just for the weights. Doesn't include KV cache and other things.When the model gets quantized to say 4bit ints, it'll be 22B params * 0.5 bytes = 11GB for example.