That's really cool! I made something similar but much simpler using R Shiny.
Edit: Looking at the featured story, I notice that the character illustration is not consistent currently. I got relatively consistent character illustration from scene to scene by asking the LLM to write a prompt for image generation based on the story text and use the same character description in each sentence. That got me pretty consistent character drawings. Also, to keep the same drawing style, my prompt was like:
Drawing style e.g., Digital painting {drawing prompt}
What do you think about the mechanics of machine learning book by Jeremy Howard? It seems to have a systematic approach to fit models and improve them.
Edit: Looking at the featured story, I notice that the character illustration is not consistent currently. I got relatively consistent character illustration from scene to scene by asking the LLM to write a prompt for image generation based on the story text and use the same character description in each sentence. That got me pretty consistent character drawings. Also, to keep the same drawing style, my prompt was like:
Drawing style e.g., Digital painting {drawing prompt}