found this lib in the comments, tried it and looks nice.
can be good for finding the xpath automatically and save the manual traversing overhead.
https://github.com/alirezamika/autoscraper
despite being undocumented, it really works well.
I tried the readme examples and all work. maybe you didn't update the wanted list in the examples because it has changed in the page.
IMO the biggest problem is the lack of js enabled content support.