What's the most popular number in Hacker News titles?(blog.omgmog.net)
blog.omgmog.net
What's the most popular number in Hacker News titles?
https://blog.omgmog.net/post/most-popular-numbers-in-hn-post-titles/
25 comments
Thanks for providing the query and a link to execute it (I didn't know about that one). Now I can play with it and find the most popular words...
"to", "the", "of". I don't know what I expected.
"to", "the", "of". I don't know what I expected.
For determining words that are important doing something like a tf-idf would make more sense, or doing some key word analysis like RAKE or YAKE.
If the author is reading: you might want to validate that the queries actually run across the entire Hacker News dataset. Last I checked, the ClickHouse playground table cuts off sometime in 2024.
https://news.ycombinator.com/item?id=48690636
It should be possible to run equivalent queries against the Hacker News table in BigQuery, which has the full dataset (but is more annoying to set up and use).
https://news.ycombinator.com/item?id=40644563
https://news.ycombinator.com/item?id=48690636
It should be possible to run equivalent queries against the Hacker News table in BigQuery, which has the full dataset (but is more annoying to set up and use).
https://news.ycombinator.com/item?id=40644563
The article mentions one reason for small numbers predominating:
> The first is listicles. “3 ways to do X”, “5 things I wish I’d known”, “10 tools I actually use”. The listicle is practically the native unit of the link post, and its count is almost always small and round. Nobody writes “17 things I wish I’d known” unless they genuinely have 17 things, which is rare, whereas “5 things” is a decision made in a title editor.
But doesn't the title mangler specifically try to strip out numbers that look like they're part of listicle titles?
> The first is listicles. “3 ways to do X”, “5 things I wish I’d known”, “10 tools I actually use”. The listicle is practically the native unit of the link post, and its count is almost always small and round. Nobody writes “17 things I wish I’d known” unless they genuinely have 17 things, which is rare, whereas “5 things” is a decision made in a title editor.
But doesn't the title mangler specifically try to strip out numbers that look like they're part of listicle titles?
Yes, it does, and it's in the submission guidelines too:
> If the title contains a gratuitous number or number + adjective, we'd appreciate it if you'd crop it. E.g. translate "10 Ways To Do X" to "How To Do X," and "14 Amazing Ys" to "Ys." Exception: when the number is meaningful, e.g. "The 5 Platonic Solids."
> If the title contains a gratuitous number or number + adjective, we'd appreciate it if you'd crop it. E.g. translate "10 Ways To Do X" to "How To Do X," and "14 Amazing Ys" to "Ys." Exception: when the number is meaningful, e.g. "The 5 Platonic Solids."
I once did some small work with a mathematician who was an online friend of mine. He was really into Benford's Law. A lot of mathematicians seem to love Benford's Law, and I wonder why that is. I'm not sure if I was rude to him, but we lost touch, and I miss him. I learned so much from his code.
Probably because it's so useful in detecting the "smell" of fraudulent numbers. Fraud is, of course, going to be most common where money is involved, but it can show up in many other places: for example, someone might be tempted to fudge their scientific data if their career depends on getting numbers that aren't quite where they want the numbers to be...
If a number distribution that should be following Benford's Law isn't, that's nowhere close to actual proof of fraud, but it can be a pointer helping you know where to start looking. Because if all the files except this one have numbers that follow Benford's Law, yet this one doesn't, then that's the place where you start digging for other, more positive, evidence of manipulation.
If a number distribution that should be following Benford's Law isn't, that's nowhere close to actual proof of fraud, but it can be a pointer helping you know where to start looking. Because if all the files except this one have numbers that follow Benford's Law, yet this one doesn't, then that's the place where you start digging for other, more positive, evidence of manipulation.
Thank you!
My guess is 1 (or 1.0) declaring something has reached 'stable'
Edit. Perhaps the title should be 'parsing numbers is hard'.
Edit. Perhaps the title should be 'parsing numbers is hard'.
We're number 1!
benfords law strikes again. useful for fraud analysis too
benfords law strikes again. useful for fraud analysis too
Probably 42, but I could be mistaken...
(2026)
That would be this year, and the story was posted ... today.
HN's convention is that the year is added for stories over one year old to indicate non-current (though still possibly interesting) submissions:
<https://news.ycombinator.com/item?id=39958349> <https://news.ycombinator.com/item?id=37728779>
HN's convention is that the year is added for stories over one year old to indicate non-current (though still possibly interesting) submissions:
<https://news.ycombinator.com/item?id=39958349> <https://news.ycombinator.com/item?id=37728779>
Disappointed at the lack of 23.
- The very next two numbers are 100 and 0. While 100 is consistent with the article's explanations, 0 still placing high despite fixing the query warrants further investigation. A quick glance at returned headlines shows the problem of phantom zeroes is not, in fact, fixed.
- The query doesn't group decimals and integers together. 2.0 is at #17 with 10k hits, while 1.0 is at #26 with 5k hits. So not only is the "version number" explanation for top numbers wrong - the claim that earlier version numbers are more common than later version numbers is wrong too.