HackerTrans
TopNewTrendsCommentsPastAskShowJobs

BoredomIsFun

no profile record

comments

BoredomIsFun
·11 дней назад·discuss
/r/localllama is not like that at all.
BoredomIsFun
·12 дней назад·discuss
> I get hallucinated tool call parameters and bizarre invocations

tweaking sampler might help
BoredomIsFun
·2 месяца назад·discuss
It would be true, if model providers did not throttle their models. I do not have definitive proof they do but the rumors are abundant.
BoredomIsFun
·2 месяца назад·discuss
> Chemical reactions are just math.

No, it is quantum mechanics. Physical world is not reducible to math, it has been long proven since early 20th century.
BoredomIsFun
·2 месяца назад·discuss
LFM models I've tried all seemed to be suffering from serious coherence issues. I found Gemmas the best at tasks requiring rock solid coherent output; even Qwen's not comparable.
BoredomIsFun
·2 месяца назад·discuss
> Qwen 3.6 burns it to the ground.

Not for creative writing or NLP.
BoredomIsFun
·3 месяца назад·discuss
It feels like a pointless conversation, if no sampler settings (min_p, temperature etc.) mentioned.
BoredomIsFun
·3 месяца назад·discuss
> An LLM is a router and completely stateless aside from the context you feed into it.

Not the latest SSM and hybrid attention ones.
BoredomIsFun
·3 месяца назад·discuss
good old illustrtation: https://www.ml6.eu/en/blog/large-language-models-to-fine-tun...

The it- one is the yellow smiling dot, the pt- is the rightmost monster head.
BoredomIsFun
·3 месяца назад·discuss
> If I offend anyone I will not be apologising for it.

What you said is simply counterfactual, so no reason to be offended.
BoredomIsFun
·3 месяца назад·discuss
Asimov is a widespread lastname in ex-USSR, esp. Central Asia. I personally know three unrelated Asimovs.
BoredomIsFun
·4 месяца назад·discuss
> Local model enthusiasts often assume that running locally is more energy efficient than running in a data center,

It is a well known 101 truism in /r/Localllama that local is rarely cheaper, unless run batched - then it is massively, 10x cheaper indeed.

> I think they mean that the DeepSeek API charges are less than it would cost for the electricity to run a local model.

Because it is hosted in China, where energy is cheap. In ex-USSR where I live it is inexpensive too, and keeping in mind that whole winter I had to use small space heater, due to inadequacy of my central heating, using local came out as 100% free.
BoredomIsFun
·4 месяца назад·discuss
Hmm...no. These two things are orthogonal. Regardless, Olmo are opensource.
BoredomIsFun
·4 месяца назад·discuss
1 and 3 contradict each other. Last thing people need is anti-AI hysteria.
BoredomIsFun
·4 месяца назад·discuss
1. What makes you think it is written by an LLM

2. Where is that rule, could you cite it?

3. How dow I know you did not use LLM for your comment?
BoredomIsFun
·4 месяца назад·discuss
> the API-driven $trillion labs?

here we go: https://huggingface.co/collections/trillionlabs/tri-series
BoredomIsFun
·4 месяца назад·discuss
please post it on /r/localllama
BoredomIsFun
·4 месяца назад·discuss
Phi-4-14b with layers duplicated (phi-4-25b) has increassed performance. Phi-4-49b has degraded vs 14b.
BoredomIsFun
·4 месяца назад·discuss
Phi-4-25 is another example.
BoredomIsFun
·4 месяца назад·discuss
You might like /r/antiai.