Alex Karp Is Saying What Every Angry CEO Is Thinking About AI(wsj.com)
wsj.com
Alex Karp Is Saying What Every Angry CEO Is Thinking About AI
https://www.wsj.com/tech/ai/alex-karp-is-saying-what-every-angry-ceo-is-thinking-about-ai-7f5f7c0c
17 comments
The problem is nobody can build a real business on models they don't control. Cursor focused on making a great AI coding experience but they didn't control Claude and got destroyed once Anthropic started explicitly training Claude to be better at using Claude code.
And then there's the cost front, a good model is soon going to be served at 90+% margin, meaning the model makers have a ton of flexibility in how they choose to subsidize their first party products. Cursor had to eat the full API price of Claude while Anthropic could sell Claude Code at a massive subsidy.
If you're an AI product then the model product synthesis is your product, and you don't get any of that from a proprietary closed model.
Thank you for addressing the substance of the article, unlike any other comment at the moment. I am hoping that this reluctance to be eaten like a grouper by a great white will drive a strong permanent open source culture across machine learning.
Palantir has sold their flavor of "consulting" (forward-deployed whatevers) as an alternative to the old-school flavors of consulting (management consultants). Now, Alex Karp is upset because there's a new, new flavor of consulting (agents) that they now have to sell against.
Not only are your FDEs old news, but the new hotness is an order of magnitude cheaper. Tough sell.
Not only are your FDEs old news, but the new hotness is an order of magnitude cheaper. Tough sell.
Is there active research in improving the density of models i.e. higher performance at lower parameter counts? Is this something that's even theoretically possible to do with the architecture?
I feel like I can have a much better model for how I can expect the cost of LLMs to change over the next few years. "Build more datacenters" reeks of "just one more lane bro" and because of Jevons paradox I'm skeptical it will bring costs down. Could ASICs and custom processors (ala Groq) move the needle here at all if the model density can't be improved?
I feel like I can have a much better model for how I can expect the cost of LLMs to change over the next few years. "Build more datacenters" reeks of "just one more lane bro" and because of Jevons paradox I'm skeptical it will bring costs down. Could ASICs and custom processors (ala Groq) move the needle here at all if the model density can't be improved?
Taalas has a pretty impressive proof of concept, but there's been no news about them recently.
https://chatjimmy.ai/
https://chatjimmy.ai/
Yes, LLM density has continuously improved. A recent 32B model beats older >100B models. It may level off at some point but no one knows when that will be.
Mixture of experts, quantisation, distillation. Lots of methods for greater efficiency.
Ah yes Alex Karp, the voice of the common man.
Voice of American *capitalists* used to the idea of investing capital to generate rent. Maybe AI can rebalance the market of capital and individual labor.
I can't decide if in my life span we did anything beyond the internet to actually make life better as a primary driver of economic growth. it feels like _everything_ is just rent seeking now.
I surprised myself by reading some content without knowing where it came from and it had a position that owning more than one home is hoarding. It dug into the relationship of landlords and buildings providing apartment homes vs single family homes. I'm not going into the whole property is theft part of it but it really struck a chord with me. I have a personal friend who constantly goes on about how great renting properties is and how much money his family makes and it really smacked me in the face how it really shouldn't "be this way".
anyways... we feel this rent seeking everyday with the death-by-a-thousand-papaer-cuts that is SaaS and subscription revenue.
i'm getting tired as i get older and i'm not sure how to make the most of the next ~half of my career and life.
I surprised myself by reading some content without knowing where it came from and it had a position that owning more than one home is hoarding. It dug into the relationship of landlords and buildings providing apartment homes vs single family homes. I'm not going into the whole property is theft part of it but it really struck a chord with me. I have a personal friend who constantly goes on about how great renting properties is and how much money his family makes and it really smacked me in the face how it really shouldn't "be this way".
anyways... we feel this rent seeking everyday with the death-by-a-thousand-papaer-cuts that is SaaS and subscription revenue.
i'm getting tired as i get older and i'm not sure how to make the most of the next ~half of my career and life.
Solar panels, battery storage, micro mobility (partially), quite a few internet driven innovations (wise, free communication, etc etc) the list goes on and on.
The problem is that investment used to be to fund risky businesses with unlimited upside and now a lot gets funded for capture / rent seeking behavior...
Anyway don't know your background but there are plenty of projects to work on that are a net positive
The problem is that investment used to be to fund risky businesses with unlimited upside and now a lot gets funded for capture / rent seeking behavior...
Anyway don't know your background but there are plenty of projects to work on that are a net positive
All I can say is, ‘fuck these people’.
No one is actually this stupid.
No one is actually this stupid.
You’re right. These are not stupid people. They are likely very out of touch, but they are not stupid. They know exactly what they are doing and they are good at it.
Often times, a stupid take is useful to manipulate people or change the discourse. We argue about how dumb the take is and get distracted about what really matters.
It’s the same strategy that causes working people to fight each other and ignore the real enemy.
Often times, a stupid take is useful to manipulate people or change the discourse. We argue about how dumb the take is and get distracted about what really matters.
It’s the same strategy that causes working people to fight each other and ignore the real enemy.
Archive is giving a 500 error. Anyone got another paywall bypass?
Similar vibe as Satya Nadella complaining about the concentration of power among a few AI giants. They are just mad that they aren't the ones in control.
0) big companies already are very comfortable using contracts to trust other people with their data. Maybe if they're inflexible on the 30-day requirement for fable some orgs will opt out but by-and-large it's already happening and it's not a blocker.
1) Cost will be a blocker. The level of token spend is untenable and the pareto curve is flattening. Most orgs are going to default to either using a distilled model from China or a distilled model from the model companies (e.g, Sonnet 5). It'd behoove Claude/OpenAI to offer a model router before another vendor wins that area.
2) Karp is selling his book. No one knows or cares what an 'ontology' is. From what I can tell, company's product is a tool that helps governments bomb people.