HackerTrans
TopNewTrendsCommentsPastAskShowJobs

mateuszbuda

no profile record

Submissions

[untitled]

1 points·by mateuszbuda·2 года назад·0 comments

comments

mateuszbuda
·10 месяцев назад·discuss
Welcome to the zoo! ScrapingFish :)
mateuszbuda
·в прошлом году·discuss
Here you can find statistics based on data scraped from Indie Hackers, but it’s not split by the tool size: https://scrapingfish.com/blog/indie-hackers-revenue
mateuszbuda
·в прошлом году·discuss
There are many different methods used by proxy providers to unethically source their IPs: https://scrapingfish.com/how-ips-for-web-scraping-are-source...
mateuszbuda
·в прошлом году·discuss
There’s AWS Bedrock Knowledge Base (Amazon proprietary RAG solution) which can digest PDFs and, as far as I tested it on real world documents, it works pretty well and is cost effective.
mateuszbuda
·в прошлом году·discuss
You can use a USB hub (example with 20 ports: https://www.sipolar.com/product/a-805p-20-ports-usb-2-0-hub/) and attach multiple USB dongles to it. This blog post describes a setup for web scraping: https://scrapingfish.com/blog/byo-mobile-proxy-for-web-scrap...
mateuszbuda
·2 года назад·discuss
Do you have an idea what would be my external IP address? On my phone connected to a mobile network, I get assigned mobile IP address which is my external IP address. It's not attached to the SIM card because it changes when I reconnected. Is it handles by the BTS software? Do I get assigned an IP address and BTS communicates on my behalf using that address which comes from the mobile network operators pool?
mateuszbuda
·2 года назад·discuss
Can I use this to run my own mobile network? Is there something like a blank SIM card which I could use for it? I don't need global coverage but is it possible to create my own BTS on a PC (with some antenna connected to it) and then have my own SIM card which I can insert into regular phone/device and have it connected to my BTS and connect to the Internet?
mateuszbuda
·2 года назад·discuss
What exactly doesn't work well? Did you consider playwright?
mateuszbuda
·2 года назад·discuss
I don’t really know. I don’t write posts to optimize for SEO (include FAQ at the end or something like that) and hope it’s just good content people will share.

There are also SEO pages which do not have any useful content. I think I should have more of them because my competitors have only SEO pages but I don’t have time for it as I have to focus on the product and customer support. Probably a good mix between useful content blog posts (maybe with SEO filling) and strictly SEO pages is best to bring traffic.
mateuszbuda
·2 года назад·discuss
Content marketing - blog posts with useful content posted around the Internet. Most traffic from HN and Reddit.
mateuszbuda
·2 года назад·discuss
I think that LLM costs, even GPT-4o, are probably lower compared to proxy costs usually required for web scraping at scale. The cost of residential/mobile proxies is a few $ per GB. If I were to process cleaned data obtained using 1GB of residential/mobile proxy transfer, I wouldn't pay more for LLM.