nschucher · HackerTrans

Maybe we can look for historical examples of how legislation had a positive impact on a widespread harmful habit.

  Early on, the U.S. Congress adopted the Federal Cigarette Labeling and Advertising Act of 1965 and the Public Health Cigarette Smoking Act of 1969. These laws—

  * Required a health warning on cigarette packages
  * Banned cigarette advertising in the broadcasting media
  * Called for an annual report on the health consequences of smoking

https://www.cdc.gov/tobacco/data_statistics/sgr/history/inde...

nschucher

há 6 anosdiscuss

They trained a >600B parameter translation model (GPT-3 is 175B parameters).

GShard: Scaling Giant Models with Conditional Computation and Automatic Sharding (https://arxiv.org/abs/2006.16668)

nschucher

há 6 anosdiscuss

I'm as impressed as anyone with GPT-3 samples, but you're sort of ignoring the symbol grounding elephant in the room regarding language models (https://openreview.net/pdf?id=GKTvAcb12b).

Language models are not grounded learners. The language produced does not really correspond meaningfully to our world except in superficial (albeit complex) ways.

Do you have thoughts on how to move forward on this problem? Maybe ask GPT-3 and see what it thinks :P

comments