Agree. Counting tokens today is like counting lines of code submitted to prove productivity. Can be completely gamed and diminishing proof productivity (aka, having any lines of code usually shows more competence than having none, but after a certain point there is no correlation and maybe a negative correlation).
What do people think of tools like www.aiqrank.com which measure on agent orchestration use, skill use etc?
I have found good success with Claude Code/AgentOS. The real question - is Elixir the best language to develop with using AI code generators? It may be?
Thank you Simon! Too many people conflate non-engineer vibe coding with engineers using ai to make themselves much more productive. We need different terms!
Look at the AI visibility tools. They all integrate with multiple LLM models, include scheduling, management of multiple external processes, data parsing, site-scraping, graphs, as well as multiple database structures. They need retry and error logic, real-time displays and updates, and multiple flow UX's, and Stripe integration with webhooks, and subscription management.
Same thing with competitor monitoring. These tools require scraping multiple sites, checking X, Facebook, Jobs sites, Crunchbase, etc, aggregating data and displaying and making sense of changes. And the same multi-process management, queuing, and Stripe integrations.
A few years ago, these would both fit into businesses requiring many months of development to get it all running. Now we are seeing dozens of companies emerging in each of these categories each month as they take weeks to build. And if one finds a cool aha (a new integration or graph or UX flow or positioning) the others can quickly follow in a week or less of AI-agent coding.
There are dozens of other categories where this is happening too.
The hard part of figuring out the nuances of the APIs and integrations and retries and AWS integrations and Rabbit MQ configurations and corner cases can all be done by AI with the right context.
If the software is doing complicated integrations, that may be a barrier as said in the article.
And to be clear, this is people using teams of Claude Code agents (either Sonnet 4.5 or Sonnet 5 and 5.5 in the future). Reliability/scale can be mitigated with a combination of a senior engineer or two, AI Coding tools like the latest Claude Code and the right language and frameworks. (Depending on the scale of course) It no longer takes a team senior and mid-level engineers many months. The barriers even for that have been reduced.
Completely agree that using Lovable, Bolt, etc aren't going to compete except as part of noise, but that's not what this article is saying.
What do people think of tools like www.aiqrank.com which measure on agent orchestration use, skill use etc?