Thanks, but that comparison is for old models, a different, non-shipped version of Devin called “Devin-base”, and doesn’t include Claude.
Slack integration, automatically pushing to CI, etc., are relatively low-value compared to the questions of “does it write better code than alternatives?”, “can I depend on it to solve hard problems?”, “will I still need a Cursor and/or ChatGPT Pro subscription to debug Devin’s mistakes?”
Looking for comprehensive benchmarks with Devin vs Cursor + Claude 3.6 vs ChatGPT o1 Pro.
In my own experience using Cursor with Claude 3.5 Sonnet (new) and o1-preview, Claude is sufficient for most things, but there are times when Claude gets stumped. Invariably that means I asked it to do too much. But sometimes, maybe 10-20% of the time, o1-preview is able to do what Claude couldn’t.
I haven’t signed up for o1 Pro because going from Cursor to copy/pasting from ChatGPT is a big DevX downgrade. But from what I’ve heard o1 Pro can solve harder coding problems that would stump Claude or o1-preview.
My solution is just to split the problem into smaller chunks that make it tractable for Claude. I assume this is what Devin’s doing. Or is Devin using custom models or an early version of the o1 (full or pro) API?
The reason it makes sense to compare them is there are problems that Claude 3.5 (or o1) can’t solve. Can Devin solve them? If yes, it’s easily worth the $500. If no, it’s a harder sell.
Intergenerational conflict is particularly salient for wealthy Americans. The death of the boomers enables the millennials’ inheritance. Millennials blame boomers for not gracefully ceding power in their own lifetimes. But boomers see millennials as waiting for their parents to die, as complacent and heartless.
This conflict does not exist to nearly the same degree in families without wealth to inherit, and in cultures that respect the wisdom of one’s elders; rejection of one’s elders/youth worship is one value that millennial Americans inherited from Baby Boomers.
As to the emails, Clegg was right when he said this:
> For Millennials, authenticity, agency, autonomy, idealism, altruism etc all seem to be top of their list of desirable virtues – for better or worse, they are difficult to reconcile with Silicon Valley these days.
Well, it’s worse, not better.
Anyway, this kind of self-conscious persona-construction is opposite to what millennials vibe with. No matter how much Zuck styles himself like a rapper or athlete, he only appeals to boomer or at best Gen X sensibilities. This is great for META stock price, but doesn’t make Zuck appealing to millennials.
Slack integration, automatically pushing to CI, etc., are relatively low-value compared to the questions of “does it write better code than alternatives?”, “can I depend on it to solve hard problems?”, “will I still need a Cursor and/or ChatGPT Pro subscription to debug Devin’s mistakes?”