1M+ LoC, 400 models still afloat: The engineering behind Transformers(huggingface.co)

4 pointsby Molbap9 miesięcy temu1 comments

1M+ LoC, 400 models still afloat: The engineering behind Transformers

https://huggingface.co/spaces/transformers-community/Transformers-tenets

1 comments

lysandre9 miesięcy temu

interesting blog if not just for the interactive plots: getting to see how all the common ML architectures are linked together and their evolution has value.

I'm guessing that as we go deeper, we'll see fewer and fewer completely novel architectures that don't depend on the previous ones.