rogerdox14·vor 2 Jahren·discussOr you could run it quantized on about $6k worth of 192GB Mac Studio — probably not that fast.
rogerdox14·vor 2 Jahren·discussVarious Internet sources claim Rashida Jones sounds a lot like Scarlett Johansson: could Rashida Jones have voiced ‘Sky’?
rogerdox14·vor 3 Jahren·discuss"recommended max working set size" is a property of the Mac the model is being run on, not the model itself. The model is smaller than that, otherwise it wouldn't be running on GPU.