stanfordkid

920 karmajoined 14 yıl önce

comments

4 gün öncediscuss

I think what you're saying might be a stretch. I strongly believe the brain holds some information in a sequential pattern -- not necessarily all of it or even the majority of it. There's a book called Moonwalking with Einstein that digs into this precise fact -- you can remember sequences much much better if you associate a visual image with each item in the sequence. Sequential association covers a lot of human knowledge but certainly not the spatial aspects. I think it's a big reason why I think LLM's might not be as smart as we think they are. The complex spatial representations are only encoded implicitly via projection on to textual descriptions.

10 gün öncediscuss

Wow amazing. I am very curious how the spider "learns" to do this technique, that it works, and to repeat it. Is this somehow encoded in the DNA of the spider? Clearly spiders don't rear their children or learn / communicate so it must be evolved and encoded somewhere in either the genes or the epigenetics. Nature is amazing.

11 gün öncediscuss

I don't fully understand how this works... who regulates and defines what is "self-hosted" or "ethical technology"... I feel you can't really solve the distributed consensus and governance problem by just introducing a new domain suffix.

2 ay öncediscuss

I don't think you can really blame AI agents for this. While I agree the user was using AI irresponsibly, some of the blame does go to Railway for making an API key that allows for all operations to happen from a single key without giving clear warnings on privileges. Clearly this user was shooting from the hip and quickly pasted whatever key they got from Railway into a file somewhere so there is some blame there, but any service that handles hosting infrastructure should provide clear UX warning to users regarding the scoping of it's credentials.

3 ay öncediscuss

No, they are able to detect errors when pointed at them but they have a lot of false positives... making them functionally useless for a large unknown codebase. They also can't build and run an exploit post-identification. Mythos can find vulnerabilities (purportedly) and actually validate them by building and running exploits. This makes it functional and usable for hacking.

3 ay öncediscuss

They are bringing in $30B in revenue with 3X YoY growth. Why do you think it is a "jig"? I do think the US economy could implode, but thats because of war and wealth inequality in the midst of hyper-inflation. AI models aren't very useful when you have penniless consumers that can't buy the products they help build. All this is to say: the models are valuable, the companies building and providing them are very valuable.

The biggest risk to AI companies IMO is further optimization and distillation of the capabilities into smaller and more efficient models. The moat these companies have right now is that higher intelligence requires more specialized and expensive compute. If you can do that for cheap then it kind of negates their business model. Everything is moving fast, we also yet to see world models/embodied AI and how that impacts thing. I think we've reached the peak with regards to capabilities of pure text trained LLMs.

3 ay öncediscuss

They basically wrote the equivalent to Claude Code and launched it as a product... how does their adoption curve lag behind John Deere?

3 ay öncediscuss

I don't find this paper very compelling. Obviously it would be fraud if the code generated simply escaped the harness vs solving the actual problem. I agree that theoretically models could learn to do that, and it is important to highlight, but my sense is that those entities reporting the benchmark scores would have an obligation to observe this behavior and re-consider the metrics they report. It is a bit like saying it's possible to cheat in football because the balls are deflatable. It matters, and some have done it, but it doesn't mean widespread cheating is taking place. The paper takes the tone that there is already a lot of cheating happening which I do not think is the case.

3 ay öncediscuss

Mind blowing! I've had this intuition for a while too, but he really gets into the heart of it.

3 ay öncediscuss

I think there are a lot of good answers here, but it really comes down to the type of content being stored and access patterns.

A database is a data structure with (generally) many small items that need to be precisely updated, read and manipulated.

A lot of files don't necessarily have this access pattern (for instance rendering a large video file) ... a filesystem has a generic access pattern and is a lower level primitive than a database.

For this same reason you even have different kinds of database for different types of access patterns and data types (e.g Elasticsearch for full text search, MongoDB for JSON, Postgres for SQL)

Filesystem is generic and low-level, database is a higher order abstraction.

3 ay öncediscuss

Not only is it no better, it is significantly worse.

3 ay öncediscuss

What's your source for this? There isn't really a lot of credible, publicly available information on what you're saying... just anecdotes. In the India v. Pakistan conflict recently a French produced Indian Rafale was downed via a Chinese long range air-to-air missle (PL-15) from a a Chinese produced J-10 jet. Even if they don't have the same hit rate, you can buy 10x for the same price.

Source: https://www.reuters.com/business/aerospace-defense/how-pakis...

3 ay öncediscuss

No one wants to liberate Iran. Israel just wants to continue committing genocide and apartheid without any opposition. Iran arms Hezbollah and Hamas, the main forms of Palestinian resistance. The whole point of this operation is to decimate those groups so ethnic cleansing can continue without any resistance. Israel could care less about the Irani people.

You are very naive if you think the IRGC truly killed 10's of thousands of it's own people. Israel openly talks about Mossad organizing and supporting the coup, and good old Donny has admitted they have given weapons to organized resistance.

I estimate that many of the death numbers come from armed resistance being killed by the IRGC, not ordinary peaceful protestors. I also think armed resistance killed many Irani citizens. There is obviously fog of war here. The thousands of deaths were likely inflated and obfuscated.

Look at the coups we have backed in the middle east (including formerly in Iran which is what originally led to the Islamic revolution) -- and you will see a pattern. Both US and Israel provide material support to groups like ISIS or actors like Bin Laden. An Al-Qaeda fighter is literally the head of Syria now thanks to Israel.

I don't love Hamas, IRGC or Hezbollah, I don't like their ideology. But it is myopic to think they exist in a vaccum.

4 ay öncediscuss

It's better than using randomly initialized weights. It's more of a theoretical exercise to explore biology. When an infant is born maybe the visual cortex already has some notion of edge detectors etc. through a system such as this one despite never having really opened it's eyes.

4 ay öncediscuss

I did a similar project but using 3D fractals I found on shadertoy feeding into ViTs. They are extremely simple iterative functions that produce a ton of scene like complexity.

I have a pet theory that the visual cortex when developing is linked to some kind of mechanism such as this. You just need proteins that create some sort of resonating signal that feed into the neurons as they grow (obviously this is hand-wavy) but similar feedback loops guide nervous system growth in Zebra fish for example.

4 ay öncediscuss

It's pretty simple... the word circle and what you can correlate to it via english language description has somewhat less to do with reality than a physical 3D model of a circle and what it would do in an environment. You can't just add more linguistic description via training data to change that. It doesn't really matter that you can keep back propagating because what you are back propagating over is fundamentally and qualitatively less rich.

4 ay öncediscuss

I'm curious to understand, why would you build your website this way vs. say jQuery. I've never really understood the HTMX ecosystem. Is this just to avoid javascript and replace that with html pages, id's and attributes? It feels like the DOM is a very clear abstraction and scripting is a more powerful way to manipulate it. What do people like or prefer about this approach and paradigm?

4 ay öncediscuss

I'm not sure I totally buy the "no plasticity" argument. If you are allowed to write to context in an agentic fashion, certainly the LLM can record intermediate answers, go back and re-rank it's memory. The "plasticity" is in the form of data that can be looked up and referenced as a shortcut. I would think this forms a Turing complete system so theoretically it can represent pretty much anything.

4 ay öncediscuss

Isn’t this kind of all bullshit. Like Anthropic licenses so many of its models through Bedrock. If the DoD has a contract with Amazon they can just use them.

5 ay öncediscuss

Shouldn't public signature of the hash of the exe file from a known key before execution fix this??? What am I missing?