I'm considering doing some ML stuff for a mobile DJ app.. like beat/bpm detection, instrument / vocal separation etc. Have you seen anything recent that might be efficient enough to run on a mobile device and process a track in a reasonable amount of time ( less than song length ) ?
Made a simple and free pushup counter app that uses the depth sensor on the iPhone to count push ups. https://PushupCounterApp.com The existing apps I tried were subscription based / unreliable / overcomplicated. It's a WIP since I hacked it together over a few days.
For the motion part, there is already an extension to gaussian splatting for moving stuff: https://dynamic3dgaussians.github.io/
You can also just string a bunch of them together to create an animation:
https://twitter.com/8Infinite8/status/1699460316529090568
For relighting, there are lots of NeRF variants that do this -- it should be possible to optimize material parameters for the splats.