New modern web crawling tool(github.com)

2 pointsby XORbit013 yıl önce4 comments

github.com

New modern web crawling tool

https://github.com/XORbit01/webpalm

4 comments

akhayam3 yıl önce

Sounds cool, but how is this different from Colly: https://github.com/gocolly/colly?

XORbit013 yıl önce

colly have 103 contribs webpalm have 1 and only sigma contrib

XORbit013 yıl önce

webpalm is a command-line tool that traverses a website and generates a tree of all the webpages and their links, additionally it can dump data from the body of the pages using regular expressions then store the result in a file.

DavidNielsen3 yıl önce

Something proudly declaring itself powered by Malwarize, that sounds comforting.