Yes this is how hyperagents work. They keep track of their different attempts to see which results in success. It does require tasks that can be measured.
This is how hyperagents work. They Have the ability to measure improvement in both the meta agent and task agents. There approach requires task agents to tackle tasks that can be empirically evaluated.
A competent manager of a software team or org should also be able to do all the things you mention for ICs minus the coding part while also inspiring, leading, people managing. Hiring an MBA to lead/manage a software product group and engineers without those capabilities is asking for sub par results.