_whm1

5 years agodiscuss

> They must be buying a database of IP address locations and VPN addresses from somebody.

There are services that can detect most commercial VPN services, e.g. https://focsec.com

_whm1

5 years agodiscuss

Focsec* provides VPN, Proxy and bot detection via an API for such use cases (trial abuse).

* https://focsec.com/

_whm1

5 years agodiscuss

There are so called "residential proxies" that use a IP from some normal consumer ISP connection, not some datacenter IP. However there are services that can detect such residentials too, e.g. https://focsec.com/

_whm1

5 years agodiscuss

Selfhosted alternative: https://github.com/kennell/curldrop

_whm1

5 years agodiscuss

This is easy to block since all IPs of these cloud machines will belong to the same ASN.

Advanced scrapers mostly use residential IPs nowadays, but there are some services to detect those too, e.g. https://focsec.com/

_whm1

5 years agodiscuss

Another self-hosted script (Python) that aims for easy integration with curl

https://github.com/kennell/curldrop

Submissions

Curldrop – a curl counterpart for file uploads

comments