HackerTrans
TopNewTrendsCommentsPastAskShowJobs

_whm1

no profile record

Submissions

Curldrop – a curl counterpart for file uploads

github.com
1 points·by _whm1·5 tahun yang lalu·0 comments

comments

_whm1
·5 tahun yang lalu·discuss
> They must be buying a database of IP address locations and VPN addresses from somebody.

There are services that can detect most commercial VPN services, e.g. https://focsec.com
_whm1
·5 tahun yang lalu·discuss
Focsec* provides VPN, Proxy and bot detection via an API for such use cases (trial abuse).

* https://focsec.com/
_whm1
·5 tahun yang lalu·discuss
There are so called "residential proxies" that use a IP from some normal consumer ISP connection, not some datacenter IP. However there are services that can detect such residentials too, e.g. https://focsec.com/
_whm1
·5 tahun yang lalu·discuss
Selfhosted alternative: https://github.com/kennell/curldrop
_whm1
·5 tahun yang lalu·discuss
This is easy to block since all IPs of these cloud machines will belong to the same ASN.

Advanced scrapers mostly use residential IPs nowadays, but there are some services to detect those too, e.g. https://focsec.com/
_whm1
·5 tahun yang lalu·discuss
Another self-hosted script (Python) that aims for easy integration with curl

https://github.com/kennell/curldrop