axiom92 · HackerTrans

axiom92

4 dagen geledendiscuss

What do you think about Grok 4.5 in comparison to Muse Spark 1.1?

axiom92

8 maanden geledendiscuss

https://www.reddit.com/r/ChatGPT/comments/14sqcg8/anyone_els...

axiom92

8 maanden geledendiscuss

This was integrated in gpt4 2 years ago:

https://www.reddit.com/r/ChatGPT/comments/14sqcg8/anyone_els...

axiom92

8 maanden geledendiscuss

And even before this work, there was "PAL: Program-aided Language Models" (https://arxiv.org/abs/2211.10435, https://reasonwithpal.com/).

Afaik PaLM (Google's OG big models) tried this trick, but it didn't work for them. I think it's because PaL used descriptive inline comments + meaningful variable names. Compare the following:

```python

# calculate the remaining apples

apples_left = apples_bought - apples_eaten

```

vs.

```python

x = y - z

```

We have ablations in https://arxiv.org/abs/2211.10435 showing that both are indeed useful (see "Crafting prompts for PAL").

axiom92

9 maanden geledendiscuss

You can do this at grok.com.

There is a "start thread" option below every conversation. You can also read the responses aloud (helpful if you want to do something async).

axiom92

9 maanden geledendiscuss

Yeah, that's the first formal reference I remember as well (although, BERT is probably the first thing NLP folks will think of after reading about diffusion).

I collected a few other text-diffusion early references here about 3 years ago: https://github.com/madaan/minimal-text-diffusion?tab=readme-....

axiom92

11 maanden geledendiscuss

From last neurips https://automix-llm.github.io/automix/