Ask HN: GPT non-deterministic, feature or bug?1 points·by jyu·há 3 anos·0 commentsSeems like GPT non-determinism is mostly from sparse MoE.Imagine if you use a DeepMind approach of tree traversal for the most promising paths, it can generate deterministic LLM responses.0 commentsPost comment—
Imagine if you use a DeepMind approach of tree traversal for the most promising paths, it can generate deterministic LLM responses.