rogerdox14·2 anni fa·discussOr you could run it quantized on about $6k worth of 192GB Mac Studio — probably not that fast.
rogerdox14·2 anni fa·discussVarious Internet sources claim Rashida Jones sounds a lot like Scarlett Johansson: could Rashida Jones have voiced ‘Sky’?
rogerdox14·3 anni fa·discuss"recommended max working set size" is a property of the Mac the model is being run on, not the model itself. The model is smaller than that, otherwise it wouldn't be running on GPU.