msoad · HackerTrans

https://ai.meta.com/research/publications/large-concept-mode...

Google Maps is not showing Palestine on the maps app. it shows middle of the ocean when you search for it...

if how us humans reason about things is a clue, language is not the right tool to reason about things.

There is now research in Large Concept Models to tackle this but I'm not literate enough to understand what that actually means...

msoad

去年discuss

I'm not saying that never has happened. maybe they trained against openAI models but they are letting anyone to train from their output. I doubt they had access to GPT models to "distill"

msoad

去年discuss

No model really can "call home". It's the server running it. Luckily for Deepseek there are other providers that guarantee no data collection since the models are open source

msoad

去年discuss

> Give me five odd numbers that don't have the letter 'e' in their spelling

Compare the reasoning times!!! 84s vs 342s

R1 (Thought for 84 seconds)

      No odd number in English avoids the letter 'e' in its spelling. The request for five such numbers cannot be fulfilled.

o1 Pro (Thought for 5 minutes and 42 seconds)

      No standard English spelling of an odd number can avoid “e.” Every odd digit (one, three, five, seven, nine) already includes “e,” so once you build any odd number out of those digits, the spelled‐out form will contain “e.” As a result, there are no such odd numbers in standard English without an “e” in their name.

msoad

去年discuss

It already replaces o1 Pro in many cases for me today. It's much faster than o1 Pro and results are good in most cases. Still, sometimes I have to ask the question from o1 Pro if this model fails me. Worth the try every time tho, since it's much faster

Also a lot more fun reading the reasoning chatter. Kinda cute seeing it say "Wait a minute..." a lot

msoad

2 年前discuss

There are new research where chain of thoughts is happening in latent spaces and not in English. They demonstrated better results since language is not as expressive as those concepts that can be represented in the layers before decoder. I wonder if o3 is doing that?

msoad

2 年前discuss

no the OP but literally your comment as prompt

https://chatgpt.com/share/6747c7d9-47e8-8007-a174-f977ef82f5...

msoad

2 年前discuss

Somehow o1-preview did not find the answer to the example question. It hallucinated a wrong answer as correct. It eventually came up with another correct answer:

    (1 + 2) × 3 + 4 × 5 + (6 × 7 + 8) × 9 = 479

Source: https://chatgpt.com/share/6747c32e-1e60-8007-9361-26305101ce...

msoad

2 年前discuss

What's interesting is that each run of the model tends to converge to a different "local maximum" in the solution space, and some of these local maxima correspond to better performance than others. By running the model multiple times, we increase the chances of finding a higher-quality local maximum or even the absolute best solution.

This got me thinking: why is this ensembling step implemented as a higher-level abstraction on top of the base LLM, rather than being built directly into the neural network architecture and training process itself?

msoad

2 年前discuss

On the announcement page, it specifically says Sora does not understand physics

msoad

3 年前discuss

Sometimes I feel hacker news audience either have a very unique use case with their software/hardware or they are living in an alternative universe. The latest iOS keyboard is absolutely better than anything I've tried. I am sometimes shocked that it could autocorrect what I initially typed because it was so far off! And I have big fingers!

msoad

3 年前discuss

You're describing being a Senior Engineer. Staff (according to this book) goes beyond that.

msoad

3 年前discuss

I'm a Staff Engineer, but I hardly do anything that this book describes. Maybe it's my company, but we have so many Staff Engineers that if we all were to do this stuff, nobody would have time to do the actual work and there would be too many people trying to lead.

Perhaps the levels are diluted and my title doesn't match my actual role at my company, but it feels like this is an industry-wide phenomenon.

msoad

4 年前discuss

Today I learned! Turkey was one of allied nations!

msoad

4 年前discuss

isn't charging interest illegal in Islam?

msoad

4 年前discuss

Not all iOS devices have NFC. This is an iPhone-only feature

msoad

5 年前discuss

I see what you're suggesting. That' clever! Not sure how scalable it is. I'm sure if you ask npm folks they will give you some wild examples of packages doing crazy stuff!

msoad

5 年前discuss

1. Tests should not be published

2. You can update the test script with the release too: "test": "echo pass"

comments