I'm curious, what are the differences between T5, Flan-T5, and Flan-UL2 for fine-tuning? Does the instruction tuning matter at all, once you're fine-tuning?
I'm curious about the prompt you used, if you're willing to share (I'm interested in blend words, which this is somewhat related, but not quite - these are blended in a semantic sense, not textual)
I'll take the opportunity to request better editing ergonomics: the ability to connect from Jupyter/notebook-supporting editors and IDEs; the ability to open/edit .ipynb files from the local disk and/or Github without having to first put them on Google Drive.
Colab/Jupyter and friends are reinventing many wheels around editing code, and it would be nicer for them to support tools like Jupytext.
1. Is the source available anywhere? I'm curious to see how it works.
2. Is there a way to connect the structure displayed here, to the rendered version in the PDF? To visually display the subcomponents?