Monday morning mistake: sudo rm -rf –no-preserve-root /serverfault.com1 ポイント·投稿者 samcolvin·6 年前·1 コメント
Playwright: Microsoft's end-to-end testing framework for Pythongithub.com1 ポイント·投稿者 samcolvin·6 年前·1 コメント
FreeBSD Journal 2020/07-08 – Benchmarking/Tuningfreebsdfoundation.org3 ポイント·投稿者 samcolvin·6 年前·0 コメント
samcolvin·6 年前·議論Victor Stinner (Python core developer focused on performance) has a great speech about this question:There are a lot of reasons actually- Performance limited by old CPython design. If you fork it you have to deal with all the legacy code.- CPython is limited to 1 thread because of the GIL.- Specific memory allocators, C structures, reference counting, specific garbage collector etc.You can find that video in here: https://youtu.be/TXRPCZ7Nmh4
samcolvin·6 年前·議論I can confirm that, scraping Google instantly needs huge effort and money. In our best we can scrape 2500 SERP per IP.But i must say using proxy services and other things did not helped us much. Because most of them were banned before we use.
There are a lot of reasons actually
- Performance limited by old CPython design. If you fork it you have to deal with all the legacy code.
- CPython is limited to 1 thread because of the GIL.
- Specific memory allocators, C structures, reference counting, specific garbage collector etc.
You can find that video in here: https://youtu.be/TXRPCZ7Nmh4