After playing around all day over the past few days, I've come to the conclusion that the system prompt goes a huge way! We've incorporated music theory and many other instructions in the system prompt for it to be able to come up with something like this.
With that, definitely looking forward to models producing good music the analytical way and not pattern finding as we see in specialized audio/music-gen models.