cjr·há 6 meses·discussalso reminds me of https://onemillionscreenshots.com(full disclosure - my screenshot api takes the screenshots :) )
cjr·há 9 meses·discussdocument.elementFromPoint to get the elem at co-ordinates, then use npm package similar to optimal-select to come up with a unique css selector.