I'm experimenting with something like you described, but there are lots of edge cases and needs a bit of polishing. But for now, I made a Chrome extension that helps tinkering with CSS selectors.
I've noted everything down and I'll improve the onboarding experience, fix and make variable names more understandable and improve the edit button.
A scraper is not editable once is queued to run or currently running, then, you need to reload the page for the edit button to appear again. I will improve this.
I could depending on the proxy I got from my provider. I'm currently working on adding the ability to select a higher quality proxy for difficult to scrape websites and to add captcha solvers as well.
But if I have to be honest, I can not guarantee it at the present time.
This app is the side-project I starter 2 months ago, it's evolving fast but I still need to add some key features for enterprise customers.
Sorry for not being more clear. The onboarding process is a simplified version of the actual scraper builder. The fields are not editable, it's just to get used to the scraping flow.
I've noted down your suggestion and I'll make this more clear or add field edition.
I'm currently working on standard pagination (click next page button) and click button + infinite scroll.
What you comment is not currently possible with a single scraper, you would need to send one to collect links and then scrape those links. But I'm also working on "nesting data" feature, and what you comment should be possible in an ETA 2-3 weeks max.
Honestly, I've been working on it for two months and didn't reach this part of the roadmap yet. I was planning to use a 2captcha integration for the first approach.
Is Code Planner free or paid?