This sounds right, but it is speculative at best. If anything it just goes to show how complex the modern cell is and how long it took to assemble all the right pieces.
Seaborn, plotly, datashader, etc. all exist to wrap matplotlib and they are wildly successful. Is there some reason an equally good interface couldn’t be written in elisp?