rogerdox14·2년 전·discussOr you could run it quantized on about $6k worth of 192GB Mac Studio — probably not that fast.
rogerdox14·2년 전·discussVarious Internet sources claim Rashida Jones sounds a lot like Scarlett Johansson: could Rashida Jones have voiced ‘Sky’?
rogerdox14·3년 전·discuss"recommended max working set size" is a property of the Mac the model is being run on, not the model itself. The model is smaller than that, otherwise it wouldn't be running on GPU.