I'm really glad for these guys, they made a phenomenal product that made life easier for me to develop on. I'm glad Google picked them for Android, it's a dream come true for a hacker.
Not all NN models are behometh BERTs, U-Nets or ResNets. Person detection, keyword spotting, anomaly detection... there are lots of smaller neural nets that can be accelerated by a wide range of hardware.