HackerTrans
TopNewTrendsCommentsPastAskShowJobs

Anaphylaxis

no profile record

comments

Anaphylaxis
·ปีที่แล้ว·discuss
This isn't true. You can `ollama run {model}`, `/set parameter num_ctx {ctx}` and then `/save`. Recommended to `/save {model}:{ctx}` to persist on model update
Anaphylaxis
·ปีที่แล้ว·discuss
Almost guaranteed this is user error. Ollama has a (tiny) default of 2048 context, so about then is probably when you noticed the results sharply decline in quality. Try 16384
Anaphylaxis
·ปีที่แล้ว·discuss
Sure but he explicitly stated, 'GPU Servers', making it likely he didn't use the CPU for inferencing, validating the question about what GPU setup did they use
Anaphylaxis
·2 ปีที่แล้ว·discuss
Pretty fun but progress doesn't seem to save on mobile. Can you make this a PWA with a manifest so it can be added to iOS home screen properly please?