anko·3 months ago·discussI would be interested to know what speeds you can get from gemma4 26b + 31b from this machine. also how rocm compares to triton.
anko·7 months ago·discuss100% this, i've been finding metal is getting very compelling against aws. For example latitude has 4 real cores and 32 GB of ram for $92/month.https://www.latitude.sh/pricing/c2-small-x86?gen=gen-2hetzner doesn't even have specs this low from what i can tell!https://www.hetzner.com/dedicated-rootserver/#cores_threads_...