samcolvin

6 лет назадdiscuss

Victor Stinner (Python core developer focused on performance) has a great speech about this question:

There are a lot of reasons actually

- Performance limited by old CPython design. If you fork it you have to deal with all the legacy code.

- CPython is limited to 1 thread because of the GIL.

- Specific memory allocators, C structures, reference counting, specific garbage collector etc.

You can find that video in here: https://youtu.be/TXRPCZ7Nmh4

samcolvin

6 лет назадdiscuss

I can confirm that, scraping Google instantly needs huge effort and money. In our best we can scrape 2500 SERP per IP.

But i must say using proxy services and other things did not helped us much. Because most of them were banned before we use.

samcolvin

6 лет назадdiscuss

Is it compatible with clickhouse?

Submissions

Monday morning mistake: sudo rm -rf –no-preserve-root /

Lightly: A Python library for self-supervised learning

Playwright: Microsoft's end-to-end testing framework for Python

Nobody Wants to Write YAML

FreeBSD Journal 2020/07-08 – Benchmarking/Tuning

Python: PEP 638 – Syntactic Macros

Tribuo, a Machine Learning Library for Java

comments