I want to use this opportunity to shill possibly the best history of science ever written: The Eighth Day of Creation [1], which describes the history of structural biology, including Watson’s various contributions. He comes across as a precocious asshole, not without talent but with a stronger eye towards self-advancement.
To my knowledge this connection was first noted in 2021 in https://arxiv.org/abs/2107.03006 (page 5). We wanted to do text diffusion where you’d corrupt words to semantically similar words (like “quick brown fox” -> “speedy black dog”) but kept finding that masking was easier for the model to uncover. Historically this goes back even further to https://arxiv.org/abs/1904.09324, which made a generative MLM without framing it in diffusion math.
[1] https://www.cshlpress.com/default.tpl?cart=17625586661954464...