HackerTrans
TopNewTrendsCommentsPastAskShowJobs

_whm1

no profile record

Submissions

Curldrop – a curl counterpart for file uploads

github.com
1 points·by _whm1·5 yıl önce·0 comments

comments

_whm1
·5 yıl önce·discuss
> They must be buying a database of IP address locations and VPN addresses from somebody.

There are services that can detect most commercial VPN services, e.g. https://focsec.com
_whm1
·5 yıl önce·discuss
Focsec* provides VPN, Proxy and bot detection via an API for such use cases (trial abuse).

* https://focsec.com/
_whm1
·5 yıl önce·discuss
There are so called "residential proxies" that use a IP from some normal consumer ISP connection, not some datacenter IP. However there are services that can detect such residentials too, e.g. https://focsec.com/
_whm1
·5 yıl önce·discuss
Selfhosted alternative: https://github.com/kennell/curldrop
_whm1
·5 yıl önce·discuss
This is easy to block since all IPs of these cloud machines will belong to the same ASN.

Advanced scrapers mostly use residential IPs nowadays, but there are some services to detect those too, e.g. https://focsec.com/
_whm1
·5 yıl önce·discuss
Another self-hosted script (Python) that aims for easy integration with curl

https://github.com/kennell/curldrop