Great writeup, always interesting to see people digging into issues like that in such detail. I work at Google and shared the article with the Gboard team. Thanks!
Google employee here, xmanger is one of the main ML experiment tracking/orchestration tool we use internally, I'm pretty excited that it is now available for other to use!
In a nutshell, xmanager allows you to:
- define an experiment, which is a collection of one or more work units (think combination of hyperparamters)
- manage the different jobs/executable required to run this experiment (TPU workers, tensorboard job, etc.)
- collect and display measurements from work units (loss, other metrics)
- keep a reproducible artifact which allows you to re-run the same experiment at any point in the future
If you are interested in time series predictions, I would suggest you had a look at darts (https://github.com/unit8co/darts). It's a well designed library which provides a unified API to deal with time series and try/compare different algorithms/frameworks like Prophet, recurrent NNs, etc.
Yeah, that's a pretty common problem. I'm sure they are actively working on making sending feedback easier :). In the meantime, your technique worked! The issue is now fixed!
That's pretty weird, thanks for reporting this! I work at Google in the Maps org, I reported your bug internally and will update this once I have a resolution.