Techniques for Distributed TensorFlow(oreilly.com)

https://www.oreilly.com/ideas/distributed-tensorflow

1 comments

Disclaimer: developer of Hops. This blog basically argues that systems like Horovod (Ring AllReduce) are architecturally superior to Parameter Server models (like TensorFlowOnSpark).