Ask HN: How does Google crawls x.com website?

2 pointsby iaziz7863개월 전1 comments

I'm trying to find out what pain points people are discussing about certain topics. My audience are mostly tech people and a lot of them happen to be on x.com.

My profile is not a hot profile. I have barely have 7 followers and most of them are spam I think. When I search my profile with keywords like `site:x.com "iaziz786"` I do not get any result. I am searching with the last 7 days filter. I have certainly posted a few posts on in a week.

However, when I search for someone who is famous (mitchellh), I got result of deep nested replies [1] he has done. I'm not sure how this works.

If it doesn't search for unpopular people, where can I get what audience are talking about?

[1]: https://www.google.com/search?q=site%3Ax.com+%22mitchellh%22+%22AGENTS.md%22&oq=site&gs_lcrp=EgZjaHJvbWUqCAgAEEUYJxg7MggIABBFGCcYOzIICAEQRRgnGDsyBggCEEUYOzIGCAMQRRg5MgYIBBBFGDwyBggFEEUYPDIGCAYQRRg9MgYIBxAuGEDSAQgxMTc5ajBqMagCALACAA&sourceid=chrome&ie=UTF-8

1 comments

bigyabai3개월 전

> where can I get what audience are talking about?

You either pay for the X API or you get nothing: https://docs.x.com/x-api/getting-started/pricing

All of these API features are free on Bluesky/Mastodon btw.