I have generated some toy experiments for a monthish - gpt to generate code to do something - and did generate some web frameworks and pipelines - I did not have it generate a database - although that may be something to try next.
I wanted to it generate circuit diagrams and molecules
Already I bet stack overflow usage has gone down because LLMs can help fixing bugs.
I think the documentation, open source code, and code examples are more important training sets.
And in. my experience the code is often maybe 95% correct, so there will be a greater premium on expert developers who can spot and fix bugs (with the aid of LLMs, since stack overflow will no longer have any answers since no one will use it having moved to LLMs)
My experiments https://www.qualitycontainers.io/ https://github.com/msrobot0/llmlexperiments/