muppet_frog·6 yıl önce·discussThis paper makes the points that it's the saddles and not local minima that are the problem: https://arxiv.org/abs/1406.2572 It was the basis for adding 'momentum' to optimizers - so that you could skate across the saddles.
muppet_frog·6 yıl önce·discuss...hmm, that was counter to my understanding (limited though it may be...) which was partially formed by this paper: https://arxiv.org/abs/1712.09913TLDR - loss landscapes are nasty, but you can tame them with skip connections.
muppet_frog·6 yıl önce·discuss...sounds like it costs much more than the $10 pi0...I imagine the OP's use case of IoT did not require huge amounts of bandwidth.