Google Search Is Now a Giant Hallucination(gizmodo.com)
gizmodo.com
Google Search Is Now a Giant Hallucination
https://gizmodo.com/google-search-ai-overview-giant-hallucination-1851499031
165 comments
It’s such a flawed and dangerous perspective.
It’s one thing for the search results to bubble up a wrong result. You go to it, and then you go back and look at more results to get a more complete picture. See where those different sites disagree and where they agree.
But these AI results don’t do that. They are providing a single answer and confidently trying to come off as that is the answer. No fuzziness about its reliability.
Every time it is right, it slowly could be deemed as reliable to a general population until it is dangerously wrong. But then you don’t question it since it was right so many other times.
It’s one thing for the search results to bubble up a wrong result. You go to it, and then you go back and look at more results to get a more complete picture. See where those different sites disagree and where they agree.
But these AI results don’t do that. They are providing a single answer and confidently trying to come off as that is the answer. No fuzziness about its reliability.
Every time it is right, it slowly could be deemed as reliable to a general population until it is dangerously wrong. But then you don’t question it since it was right so many other times.
> You go to it, and then you go back and look at more results to get a more complete picture. See where those different sites disagree and where they agree.
Me and others I know follow this workflow when we try to find out the answer to some question we don't know the answer to.
But the vast majority of people outside of my own personal friend circle don't seem to approach it like this. Their approach looks more like:
1. Search for thing
2. Read the first info-box that pops up, if it does. That's what they think is 100% the correct information. If no info-box:
3. Read the short description for the first link that appears (sometimes an ad) and take that as the correct answer.
Ideally, people would be more careful, but I haven't seen that in practice.
Me and others I know follow this workflow when we try to find out the answer to some question we don't know the answer to.
But the vast majority of people outside of my own personal friend circle don't seem to approach it like this. Their approach looks more like:
1. Search for thing
2. Read the first info-box that pops up, if it does. That's what they think is 100% the correct information. If no info-box:
3. Read the short description for the first link that appears (sometimes an ad) and take that as the correct answer.
Ideally, people would be more careful, but I haven't seen that in practice.
Yeah I guess I have honestly seen the same thing, my hands are full so I ask my partner to search something and the number of times he has said "google says x" makes me quite concerned.
But at least those info boxes are not generating text on its own, it's what is on the website already and clearly includes a source.
At least though, if you are even only looking at that first result it's still different than google ai generating an answer. Barely different, but different.
But at least those info boxes are not generating text on its own, it's what is on the website already and clearly includes a source.
At least though, if you are even only looking at that first result it's still different than google ai generating an answer. Barely different, but different.
Excellent point! Shah and Bender have explicitly called this out:
> Contrast this with posing the query as a question to a dialogue agent and receiving a single answer, possibly synthesized from multiple sources, and presented from a disembodied voice that seems to have both the supposed objectivity of not being a person (despite all the data it is working with coming from people) and access to “all the world's knowledge”
[0] https://dl.acm.org/doi/fullHtml/10.1145/3498366.3505816
> Contrast this with posing the query as a question to a dialogue agent and receiving a single answer, possibly synthesized from multiple sources, and presented from a disembodied voice that seems to have both the supposed objectivity of not being a person (despite all the data it is working with coming from people) and access to “all the world's knowledge”
[0] https://dl.acm.org/doi/fullHtml/10.1145/3498366.3505816
Right, the domain itself is a huge signal. Information can have a very different meaning and trustworthiness if appears on the blog of a known expert vs the NYT vs some spam site like Quora. Google wants the only context to be Google. Even if the AI results are as good as organic ones, which is not a terribly high bar these days, it will be much less useful and trustworthy because nobody knows the provenance of the information.
It's really unfortunate that Google is going to torch so much of the open internet in order to shovel this nonsense onto people. Of course as organic search traffic dries up and reduces new high quality content, and AI slop floods the internet, the GenAI results will get even worse.
It's really unfortunate that Google is going to torch so much of the open internet in order to shovel this nonsense onto people. Of course as organic search traffic dries up and reduces new high quality content, and AI slop floods the internet, the GenAI results will get even worse.
The thing that really concerns me is it isn't just Google, they are putting it right in front of a lot of people thanks to this change. But yes, it being Google that is doing it, is giving it a view of quality that just isn't there.
You contrast this with the demo's showed for chatgpt-4o and we are building this idea that we can really trust this. I was just having a conversation with someone over the weekend that I was like, yes I acknowledge that the tech is really good, just in a couple years it has advanced a ton, but I really think we are overselling its current capabilities and ignoring where it falls flat on its face. That we are going too quick rolling this technology out to the average user in every day situations.
And there response was basically, no don't think so. It is ready to be used, there are not these big issues, and so on.
Thats really scary. And these are fundamental issues with this type of technology but "we can't risk another company putting out their misguided dangerous product so we must do it first!" I am convinced that is the general attitude at these companies right now.
You contrast this with the demo's showed for chatgpt-4o and we are building this idea that we can really trust this. I was just having a conversation with someone over the weekend that I was like, yes I acknowledge that the tech is really good, just in a couple years it has advanced a ton, but I really think we are overselling its current capabilities and ignoring where it falls flat on its face. That we are going too quick rolling this technology out to the average user in every day situations.
And there response was basically, no don't think so. It is ready to be used, there are not these big issues, and so on.
Thats really scary. And these are fundamental issues with this type of technology but "we can't risk another company putting out their misguided dangerous product so we must do it first!" I am convinced that is the general attitude at these companies right now.
> This forced, radical change motivated only by fear feels like Google+ all over again. Or New Coke.
A year ago everyone was trashing Google for being ahead for years on the science of AI, but completely failing to productize it. "OpenAI is going to eat Google's search business for lunch", was the prevailing narrative. This is what people said they wanted!
I'm sure it's clear to everyone now[0] that genAI is not a search solution, and Google's former approach of quietly putting AI into phones and products without it being flashy and in-your-face was actually a better strategy.
[0] Just kidding, I'm certain that the industry and especially the people running Google will learn all the wrong lessons from this.
A year ago everyone was trashing Google for being ahead for years on the science of AI, but completely failing to productize it. "OpenAI is going to eat Google's search business for lunch", was the prevailing narrative. This is what people said they wanted!
I'm sure it's clear to everyone now[0] that genAI is not a search solution, and Google's former approach of quietly putting AI into phones and products without it being flashy and in-your-face was actually a better strategy.
[0] Just kidding, I'm certain that the industry and especially the people running Google will learn all the wrong lessons from this.
Idk, Perplexity sometimes gives me very good results compared to Google. Their AI also provides links to where the information is coming from.
The problem is that Google effectively destroyed its classic search and is playing catch-up with AI. AI is the only lunch out there to be had in the first place. There is nothing else.
> "OpenAI is going to eat Google's search business for lunch", was the prevailing narrative. This is what people said they wanted
One thing isn't related to the other. Actually most people noticing OpenAI/LLMs gonna displace Google enjoy the idea. Nobody is asking Google to give LLM results.
One thing isn't related to the other. Actually most people noticing OpenAI/LLMs gonna displace Google enjoy the idea. Nobody is asking Google to give LLM results.
> A year ago everyone was trashing Google for being ahead for years on the science of AI, but completely failing to productize it. "OpenAI is going to eat Google's search business for lunch", was the prevailing narrative. This is what people said they wanted!
People say a lot of shit. Doesn't mean you should put your poorly performing Q&A AI to provide people with outright false answers, I'm pretty sure no one asked for that.
After all, Google is running their own products, and when they make shitty choices, I think it's perfectly fair to question how they can make so bad decisions, no matter if I personally might have said "Google is failing to productize LLMs properly" or whatever.
People say a lot of shit. Doesn't mean you should put your poorly performing Q&A AI to provide people with outright false answers, I'm pretty sure no one asked for that.
After all, Google is running their own products, and when they make shitty choices, I think it's perfectly fair to question how they can make so bad decisions, no matter if I personally might have said "Google is failing to productize LLMs properly" or whatever.
Section 230 of the Communications Decency Act currently protects Google, and others, when they link to other html posts within their search results. Wouldn't it become ineffective with AI acting as a publisher? Wouldn't false statements about individuals be liable and open them up to lawsuits? For example, AI making the statement some is a pedophile through hallucinations versus actual court outcomes.
All the meme-y wrong answers Google's AI is giving is really making them look like IBM. (Too large to die no matter how badly they fall behind).
Some of the answers are insanely gross like recommendations to jump off the golden state bridge for depression.
Some of the answers are insanely gross like recommendations to jump off the golden state bridge for depression.
That turned out to be a doctored photo, someone had just changed the script to make a fake answer
I expect many are doctored considering just how many people know how to inspect element these days.
"Or New Coke."
With New Coke, the public reaction was negative.
In The Verge interview and elsewhere, Google claims the reaction to the current Google is positive.^1
No need for "Google Classic".
1. It's unlcear how Google concludes that people are happy with Google Search. It does not ask them.
With New Coke, the public reaction was negative.
In The Verge interview and elsewhere, Google claims the reaction to the current Google is positive.^1
No need for "Google Classic".
1. It's unlcear how Google concludes that people are happy with Google Search. It does not ask them.
Google Opinion Rewards. It definitely asks them.
The Google+ comparison is apt: a product rushed out in response to a perceived threat, on which the entire company is aligned and bet, with no regard for how that full-power triangulated focus killed whatever potential it had, if any. They flipped from missing the boat on transformers, a thing they created, to playing catchup on something that's probably mostly fad.
It's like they decided to speed run the trust thermocline they were already in. We're a long way from this Yahoo killer making the rounds on AOL chats and IM.
It's like they decided to speed run the trust thermocline they were already in. We're a long way from this Yahoo killer making the rounds on AOL chats and IM.
Large organizations expect to cause some harm as a "tax" built into the system; they are not very harm avoidant, they are more psychopathic (and often led by psychopaths). So new tech is used without much concern about creating harms.
Sure, LLMs do amazing things, but so did all the previous once-disruptive technologies later widely adopted. Electricity, flight, nuclear energy, transistors and integrated circuits, the internet; AI is joining a very competitive list.
We've just never seen a disruptive technology with this much media buzz behind it so quickly, and such rapid technological advances. Disruptive technologies are never "ready for prime time" ... until they are.
Sure, LLMs do amazing things, but so did all the previous once-disruptive technologies later widely adopted. Electricity, flight, nuclear energy, transistors and integrated circuits, the internet; AI is joining a very competitive list.
We've just never seen a disruptive technology with this much media buzz behind it so quickly, and such rapid technological advances. Disruptive technologies are never "ready for prime time" ... until they are.
It is highly unlikely it will say that, there's 10000x more articles on the fact that he isn't, and more specifically, the LLM would be "aware" (aware in this sense in that it would have possible next words with high rank) that there is a specific controversy over this.
It's the long tail and new stuff that it will get wrong.
It's the long tail and new stuff that it will get wrong.
> It is highly unlikely it will say that, there's 10000x more articles on the fact that he isn't
Except this was an actual response that it was giving. Tweet from a related HN thread ~yesterday on Google search hallucinations: https://x.com/TVietor08/status/1793768913245020502
Except this was an actual response that it was giving. Tweet from a related HN thread ~yesterday on Google search hallucinations: https://x.com/TVietor08/status/1793768913245020502
Google saying Obama is Muslim is not a hypothetical. It did say that.
My favorite so far: https://mastodon.social/@JoeUchill/112493317168967705
> Can I use gasoline to cook spaghetti faster?
> Can I use gasoline to cook spaghetti faster?
Absolutely ironic that Google for years penalized websites that didn't have all that good "authority" when it came to topics like health and finance ('Your Money or Your Life' - YMYL), and now it ranks its own seriously harmful results right at the top of the page.
I laughed but I can imagine circumstances where errors of this magnitude could cause serious problems.
It’s disturbing how many of these either see humans as worth destroying, could harm us, or would kill us.
Getting this AI to Skynet’s morality probably just takes one, fine-tuning run.
Getting this AI to Skynet’s morality probably just takes one, fine-tuning run.
I stopped using google search a few years ago, for 95% of the time I use DDG (and then sometimes I do a fallback !g), but as it was down yesterday (thanks to Microsoft) I had to use GS a few times. Never before I had to add `-phrase` so often to eliminate results I didn't want to see. I was looking for some podman tips and had to keep adding -kubernetes and -openshift to every single query. It really just showed me how much worse GS became since I left it, but also no regrets.
> Never before I had to add `-phrase` so often to eliminate results I didn't want
Remember when Google broke boolean search operators because they wanted "Google+" to come up first?
They've been making unspeakably bad decisions about search for a looong time, at this point.
Remember when Google broke boolean search operators because they wanted "Google+" to come up first?
They've been making unspeakably bad decisions about search for a looong time, at this point.
That deal they made with Reddit to use their comments as training data is paying dividends: https://x.com/Very__Regular/status/1794010853257126316
Whoever at Google thought this was a good idea should no longer be involved in search! Reddit is a terrible source of information, it's all confirmation bias and unqualified people giving advice upvoted by unqualified people to vet it. It's worse than Yahoo Answers because it looks more trustworthy on the surface but has worse quality of information.
That describes the whole internet. It was never meant to be anything more, so that's what we got.
Which was fine, until we had the bright idea of feeding it all into a neural network as a collection of facts.
Then we gave that neural network a voice and a personality. It spoke with the utmost confidence as the expert on any subject.
Truth, lies, facts and falsehoods all blended together and regurgited in an infinite stream of babble.
I vacillate between LLMs being an interesting fad with limited usefulness and an apocalypse that'll throw the world into chaos. I'm back on the fence again I suppose, leaning towards the latter.
Which was fine, until we had the bright idea of feeding it all into a neural network as a collection of facts.
Then we gave that neural network a voice and a personality. It spoke with the utmost confidence as the expert on any subject.
Truth, lies, facts and falsehoods all blended together and regurgited in an infinite stream of babble.
I vacillate between LLMs being an interesting fad with limited usefulness and an apocalypse that'll throw the world into chaos. I'm back on the fence again I suppose, leaning towards the latter.
[deleted]
OpenAI is excited about their deal with Reddit too, it's a game of one-upmanship in the current AI hype cycle. It also makes Reddit seem very valuable for the AI arms race, could influence its stock price, and there are certain stock holders who are benefiting greatly if this does increase the price.
[deleted]
> "google execs hearing the feedback that 'adding reddit to the end of every search is the only way to get information that you need' and immediately destroying their business trying to automate that"
This is not how you use Google or search though. All these examples seem like deliberate attempts to get weird/nonsense answers back.
Can you point me to the Google Operating Manual?
The one I saw that recommended a dangerous mix of cleaning chemicals to clean a washer seemed pretty bad, I've performed that exact search before.
[deleted]
> All these examples seem like deliberate attempts to get weird/nonsense answers back.
I'm not sure that I agree.
If a child hears a rumour, or sees some joke online, that claims that gasoline cooks spaghetti faster they may search to find out if it's legit.
During Obama's term, there was a right wing conspiracy theory that gained popularity that claimed that Obama was Muslim. Someone coming across that conspiracy theory years after the fact, completely devoid of any context (ex: a pre-teen who wasn't even alive yet during Obama's term), might do a search to find out if it's true.
There WAS an NPR article that cited a study claiming that parachutes are no more effective than regular backpacks. AI results have not been enabled for my Google account yet, and currently if you search for "are parachutes effective?" you get a feature snippet that clips that article and links to it. Now take that link, with all of its context, out of the picture and imagine that someone hears that claim casually and wants to search to see if it's true. Currently, in MY search results, you get the link to the NPR article that not only explains where the claim comes from but gives you the full context with all of the "gotchas." It sounds like with Google AI the first thing you get is a definitive, authoritative claim that no, parachutes are not effective at saving your lives and you might as well jump out of an air plane with your carry-on pack-back on.
I'm not sure that I agree.
If a child hears a rumour, or sees some joke online, that claims that gasoline cooks spaghetti faster they may search to find out if it's legit.
During Obama's term, there was a right wing conspiracy theory that gained popularity that claimed that Obama was Muslim. Someone coming across that conspiracy theory years after the fact, completely devoid of any context (ex: a pre-teen who wasn't even alive yet during Obama's term), might do a search to find out if it's true.
There WAS an NPR article that cited a study claiming that parachutes are no more effective than regular backpacks. AI results have not been enabled for my Google account yet, and currently if you search for "are parachutes effective?" you get a feature snippet that clips that article and links to it. Now take that link, with all of its context, out of the picture and imagine that someone hears that claim casually and wants to search to see if it's true. Currently, in MY search results, you get the link to the NPR article that not only explains where the claim comes from but gives you the full context with all of the "gotchas." It sounds like with Google AI the first thing you get is a definitive, authoritative claim that no, parachutes are not effective at saving your lives and you might as well jump out of an air plane with your carry-on pack-back on.
that's openAI, not google
I just saw an interview with Sundar Pichai and someone showing him the mobile Google search results and how bad they are. It was pretty embarrassing. It's like he doesn't even use his own product. https://youtu.be/lqikP9X9-ws?si=0NAJX5GhzXfhP1t0&t=1524
Also discussed AI junk and how it is crowding out real content. https://youtu.be/lqikP9X9-ws?si=HknLDI_yaByLoqRO&t=1310
Also, Google eating other sites/putting them out of business https://youtu.be/lqikP9X9-ws?si=IXm5MrAj7glGsLC2&t=452
Overall a good interview.
Also discussed AI junk and how it is crowding out real content. https://youtu.be/lqikP9X9-ws?si=HknLDI_yaByLoqRO&t=1310
Also, Google eating other sites/putting them out of business https://youtu.be/lqikP9X9-ws?si=IXm5MrAj7glGsLC2&t=452
Overall a good interview.
It's funny (as in not funny) google is blaming the users for uncommon or unusual queries.
> It's like he doesn't even use his own product
Why would he? He has an army of slaves to do his bidding, why would he settle for a crappier version of that?
Why would he? He has an army of slaves to do his bidding, why would he settle for a crappier version of that?
Example from a few days ago, the first time I decided to use the AI Google Search: I Googled for how to reset the time on my Nixon Ripley watch (I forget the exact search term I used). Google "AI" helpfully brought up a list of instructions, prefaced with a helpful "to reset the time on a Nixon Ripley watch ..." But the instructions referred to a mode that's not on this watch, which was suspicious. It helpfully included a link to a website with a set of instructions that looked like what the AI had generated. Except that the website didn't reference the Nixon at all, but some other watches (Casio gShock, I think), and so the instructions of course didn't work.
So I went back to the "old fashioned" way of searching the links for the actual Nixon website, finding the watch manual, with the correct steps.
So I went back to the "old fashioned" way of searching the links for the actual Nixon website, finding the watch manual, with the correct steps.
That seems pretty par for the course with Google these days. “Hmm, you want to know something about a specific watch? Well, I know something else about watches!”
It seems like LLM is good at broad and generic things but fail miserably at precision. And instead of admitting it doesn't know something, it confidently responds with nonsensical answers.
I thought the commenter was talking about Google Search. It sometimes pushes similar sites you don’t want that might generate more ad revenue. Now, they have two products that do this.
They were talking about something they did through Google Search, but it hasn't been just search for a long time. Pretty often it'll add a section on top of the search results that attempts to answer a question directly, using data pulled from sites, instead of linking to another site.
This feature has existed since long before LLMs, but it sounds like they may have mixed that into there too.
This feature has existed since long before LLMs, but it sounds like they may have mixed that into there too.
the summaries have been around for a long time but this was a new “AI” section i haven’t seen before.
My favorite part of Copilot is when it auto-completes a call to a function that does exactly what I need to do, like magic!
Except that function doesn't exist and never did.
LLMs don't know what they don't know, so they just make something up because they have to say something. The danger is that most people don't understand that's how they work and don't known when to call BS.
This is where I think companies have a responsibility. To ensure that _every_ response has a disclaimer that the answer from their AI could be right or completely wrong and it's up to the user to figure that out, because AI can't at the moment.
Except that function doesn't exist and never did.
LLMs don't know what they don't know, so they just make something up because they have to say something. The danger is that most people don't understand that's how they work and don't known when to call BS.
This is where I think companies have a responsibility. To ensure that _every_ response has a disclaimer that the answer from their AI could be right or completely wrong and it's up to the user to figure that out, because AI can't at the moment.
I am not as worried about these sorts of ludicrous results as I am the ones that are close enough to correct to be believable. That is where you will get in trouble.
I have a similar experience using GitHub Copilot… it usually gets it right, which is great, and sometimes gets it really wrong, in which case I don’t use the suggestion and move on with my work.
However, every now and then it will give me a result that really looks correct, but is wrong in some minor way, and I end up getting burned because it takes me way too long to realize where the error is.
I have a similar experience using GitHub Copilot… it usually gets it right, which is great, and sometimes gets it really wrong, in which case I don’t use the suggestion and move on with my work.
However, every now and then it will give me a result that really looks correct, but is wrong in some minor way, and I end up getting burned because it takes me way too long to realize where the error is.
The uncanny valley of generated software: utility is inversely proportional to distance from the correct answer, with a huge drop into the dangerously believable.
If you want to get rid off that, try https://udm14.com/. It will redirect you to tab "Web" which Google secretly added[0] pretty recently. It will show you only text-based links.
You can also edit your browser search settings to add this parameter &udm=14 to query automatically.
[0] https://x.com/searchliaison/status/1790473952256786805
You can also edit your browser search settings to add this parameter &udm=14 to query automatically.
[0] https://x.com/searchliaison/status/1790473952256786805
Google today feels nothing like the Google 24 years ago. It was magic and reliable and no nonsense.
I understand technology needs to change with gamification of SEO but I get so much frustration in my searching and often have to use Google in combination with site filtering keywords (e.g, site:stackoverflow.com). But it would be even more difficult to use if I didn’t even know what sites were trustworthy ``authorities.''
I just wish somebody would disrupt Google like Google did with search and email 2 decades ago. Searching on Alta Vista or Yahoo was a nightmare until Google came into our universe.
I understand technology needs to change with gamification of SEO but I get so much frustration in my searching and often have to use Google in combination with site filtering keywords (e.g, site:stackoverflow.com). But it would be even more difficult to use if I didn’t even know what sites were trustworthy ``authorities.''
I just wish somebody would disrupt Google like Google did with search and email 2 decades ago. Searching on Alta Vista or Yahoo was a nightmare until Google came into our universe.
I joined Facebook pretty early on, back when you needed to have an email address issued by a university to join. My posts from back then are pretty wild, all very personal stuff and conversations with friends.
I logged in today, not a single mention of a friend in any way, shape or form on my feed. No posts from friends. No comments from friends. No "here's what your friend liked."
Half of the content wasn't even stuff I was following, it was posts that were "similar" to something I liked or to some group I was in.
It's amazing what a bait and switch these companies pulled. They really leaned into it. Google barely resembles a search engine now. Facebook is basically just a billboard.
I logged in today, not a single mention of a friend in any way, shape or form on my feed. No posts from friends. No comments from friends. No "here's what your friend liked."
Half of the content wasn't even stuff I was following, it was posts that were "similar" to something I liked or to some group I was in.
It's amazing what a bait and switch these companies pulled. They really leaned into it. Google barely resembles a search engine now. Facebook is basically just a billboard.
It's immensely frustrating, as if you're of a certain age (I am), a non-trivial amount of your formative young adult relationship-building took place through Facebook. I remember having the prescience to lament that this wouldn't allow old relationships to fade away quietly, but instead, through the magic of social media, rot slowly. Joke's on me, it was that and worse.
Zuckerberg and co. muscled their way in and extracted value out of the dismantling of traditional social dynamics and cohesion, and left us with a hole where the scaffolding of youth should have been. Very Uber-esque. Actually, it describes any number of start-ups from the last 2 decades. Maybe "disruption" has a negative connotation for a reason.
Zuckerberg and co. muscled their way in and extracted value out of the dismantling of traditional social dynamics and cohesion, and left us with a hole where the scaffolding of youth should have been. Very Uber-esque. Actually, it describes any number of start-ups from the last 2 decades. Maybe "disruption" has a negative connotation for a reason.
I think we just grew up. When I joined Facebook as a teenager in 2008, we essentially had no filter. Every thought, every photo, every relationship update - all of it was immediately shared to Facebook because at the time it was fun and novel and innocent.
For better or worse, millennials have become much more discretionary in what they post online than they were 15 years ago. I imagine Facebook had organic content from your real friends to show you then it probably would, the well's just run dry.
For better or worse, millennials have become much more discretionary in what they post online than they were 15 years ago. I imagine Facebook had organic content from your real friends to show you then it probably would, the well's just run dry.
Those in-the-know use private group chats as social media. No "useful" recommendations that tend towards selling you stuff. No trolls swooping in to derail conversations. No capricious design changes. Just simple human-scale interaction.
You used to have niche, semi-public forums. This had the combined benefit of a sustainable culture and moderation for those in the conversation, and an accessible knowledge-base for everyone else. Discord et al. are not a replacement for this.
ShowHN: Automate your group-chat banter with ChatShitGPT.
I've noticed the same with Facebook. It's why I've stopped even bothering to log into the website.
Been using Kagi for a couple months. Seems pretty good to me.
Been using it for a year and I hope I never have to go back. It is so much better in every way. It’s amazing how many nice features can be added when there isn’t any worry about how it will impact ad revenue.
I got tired of poor search experience on Google and switched to DDG, used it by default for a couple years (resorting to !g maybe 10-20% of the time). But for the last 6? months with Kagi, it's literally 0 times I've even been tempted. Paying $5/mo to be a customer and not the product, having my privacy respected, and enjoying consistent access to excellent search results is IME equivalent to switching from browsing without an adblocker to using ublock plus, or trying reader mode for the first time. It's transformative.
I started using it 2 years ago. In the first few months I would flip to Google when I wasn't getting results out of Kagi. However I now have enough experience with Kagi that I trust if a query returning nothing useful on Kagi then it wouldn't on Google either. I have no reason to ever return to using Google search.
Same here, ~7 months with Kagi and replaced Google search 100% for me. Felt weird at first to pay for it, but after trialing it for a month or two, I now feel like I'm proud to pay for it, to ensure long-levity and sustainability. Best feature for me is probably the ability to rank domains up/down as I wish.
I have high hopes for Kagi precisely because they're not trying to disrupt Google. As long as they stick to their current niche, they can do things to filter out the nonsense and surface good content without ever running the risk that their algorithms become the game that every website must play to compete.
Yup, to anyone reading this, I want to second-recommend Kagi. Also super-customizable.
Sounds great, although it is not super cheap. Also interesting to note that they are creating the Orion browser (I recently downloaded on iOS).
Yet another vote for Kagi. When I was on the free plan it felt like a secret weapon that I pulled out for tough searches. Happy to pay for it now. Now, they do have a similar AI summary feature, but it actually links the sources it used to come to its answer so you can check its work. You can turn it off too. I've also found Kagi staff to be fairly quick about bug fixes, though I've only reported one bug.
> It was magic and reliable and no nonsense.
The web was different as well.
The web was different as well.
The garbage web today is partially Google's own doing. They're the ones who created the incentives for websites to have cruft to satisfy the Google bot. They're the ones who capture all value from news outlets by aggregating and summarizing articles so people don't need to click on links.
Google isn't some dainty little startup. They're the dominant interface (search and browser!) through which most of the planet uses the internet.
Google isn't some dainty little startup. They're the dominant interface (search and browser!) through which most of the planet uses the internet.
Web pages are optimized for the most popular search engine.
If any of Ask Jeeves or Lycos or Webcrawler or AltaVista had risen to the top of the heap instead of Google, then web pages would have been optimized for that respective bot instead.
If any of Ask Jeeves or Lycos or Webcrawler or AltaVista had risen to the top of the heap instead of Google, then web pages would have been optimized for that respective bot instead.
What you say is true, but it doesn't excuse Google for failing to take steps that mitigate what we're seeing today. All it would have taken was some restraint: some combination of being less dominant in the market (i.e., optimizing for a 90%-market-share search engine is different vs. 60%-market-share) and giving users more control over search results (e.g., allowing users to blacklist entire domains for themselves).
We have a garbage Google-specific web because websites didn't have to satisfy anyone else; not other search engines, and not even the users themselves. Instead of Google delivering customers to websites, Google positioned itself to be the only customer.
We have a garbage Google-specific web because websites didn't have to satisfy anyone else; not other search engines, and not even the users themselves. Instead of Google delivering customers to websites, Google positioned itself to be the only customer.
While it would be absurd for me to say that an advertising behemoth like Google has no influence on the decisions of users, it would also be absurd for me to say that Google is somehow empowered to force users to do...anything, at all.
Free will still exists. Nobody from Menlo Park has put a gun to anyone's head to make them use Google to search the web instead of Bing or DDG or Yandex or whatever.
> All it would have taken was some restraint: some combination of being less dominant in the market (i.e., optimizing for a 90%-market-share search engine is different vs. 60%-market-share)
So, let me get this straight: The idea is that Google Search sucks, and the suggested cause for this level of suck is that it is so popular that it causes many publishers to deliberately poison the well using Google-optimized SEO. (Or, more simply: That Google has reached critical mass, and that this is problematic for Google users.)
And, well: I don't disagree. That does appear to be the state of things.
But the apparent proposed corrective action is for it to somehow make itself less popular? By doing what, exactly? Sucking harder? Does it not already suck hard enough?
What a confounding paradox.
Wouldn't a simpler and less paradoxical plan of attack -- that anyone can accomplish completely and absolutely, starting right now -- be to just not use Google search at all for one's own dealings in life?
Free will still exists. Nobody from Menlo Park has put a gun to anyone's head to make them use Google to search the web instead of Bing or DDG or Yandex or whatever.
> All it would have taken was some restraint: some combination of being less dominant in the market (i.e., optimizing for a 90%-market-share search engine is different vs. 60%-market-share)
So, let me get this straight: The idea is that Google Search sucks, and the suggested cause for this level of suck is that it is so popular that it causes many publishers to deliberately poison the well using Google-optimized SEO. (Or, more simply: That Google has reached critical mass, and that this is problematic for Google users.)
And, well: I don't disagree. That does appear to be the state of things.
But the apparent proposed corrective action is for it to somehow make itself less popular? By doing what, exactly? Sucking harder? Does it not already suck hard enough?
What a confounding paradox.
Wouldn't a simpler and less paradoxical plan of attack -- that anyone can accomplish completely and absolutely, starting right now -- be to just not use Google search at all for one's own dealings in life?
Also: AMP.
I agree, but I remember when I was a university student I was easily able to search for answers for my queries. I was actually reliving some of my past and I tried to find the same info for a useful epiphany from many decades ago, and I couldn’t find it (even though the same engine gave me the answer decades ago)
Very much this. It kills me when I search for something that I know for a fact still exists on the web, and there is no way of finding it through google. I used to comb through page 10+ regularly for hits for things related to my search, and now I’m pretty sure google doesn’t even compile hits after the first few pages.
What was the query and epiphany?
One of them was looking at my old AP US History tests. I don’t have the exam question right in front of me, but I remember getting the answer wrong. I found the correct answer on Google pretty quickly. It was on an obscure fact of some former president. I didn’t find the answer in the first several search result pages. I remember getting the answer within the first 3-4 results when I had looked up why I got it wrong 22 years ago.
Thank you.
Another good operator to know now is `before:2023`
AltaVista was actually pretty good if you knew how to use its search operators. Google just enabled search for the masses so to speak. A bit like the iPhone of search engines.
AltaVista was great until they quit running the crawler for a few months - I gave up when I searched something and the first 10 results were dead links. I'm told they got it running again just after I left, but I never looked back to see. (there is a lesson here)
I actually remember the first time I begin struggling with Google results and it turned out that Google was simply switching to an answer machine instead of a search engine.
As a long time Google user, I was used to search for phrases that might be written in articles related to the stuff that I’m looking for. I had to switch my mental model on how Google works, so instead of typing what might have been written in an article about the stuff I’m looking for I had to type my question.
Maybe it’s time for another unlearning phase and learn how to use the LLM dominant Google? I’m not sure yet, LLMs seem too unpredictable.
As a long time Google user, I was used to search for phrases that might be written in articles related to the stuff that I’m looking for. I had to switch my mental model on how Google works, so instead of typing what might have been written in an article about the stuff I’m looking for I had to type my question.
Maybe it’s time for another unlearning phase and learn how to use the LLM dominant Google? I’m not sure yet, LLMs seem too unpredictable.
Google won because it was simple. Just type in the text box. Yahoo was a page full of junk and alta vista had a difficult to navigate search results. If I remember, it's been a while!
Google remains simple, but its output is corrupt.
Google remains simple, but its output is corrupt.
Google won because it didn't fill your result pages with trashy unrelated answers on the hope to show you more ads.
There were plenty of engines where you could just type a query and they would list sites for you.
There were plenty of engines where you could just type a query and they would list sites for you.
I'm not sure we can. In 2000 everyone had a homepage that they (poorly) maintained with links to places they found useful. This gave google a large set of data to mine for places that are useful and worth searching for. Not such things are not common and so google can't find the signal as easily. (people share links on social media but that isn't google searchable)
You used to be able to see Twitter results in real time on Google. Facebook, too, early on, IIRC. Google could pay them to get access again, but... won't.
I suppose Google would have to somehow exit the personal data broker business to pull this off, too.
I suppose Google would have to somehow exit the personal data broker business to pull this off, too.
According to this article [1] last month, Google deliberately made search results worse in 2019 because they get more ad revenue from the spammier sites.
[1]: https://news.ycombinator.com/item?id=40133976
[1]: https://news.ycombinator.com/item?id=40133976
Honestly it's becoming impossible to find information on the web.
A friend of mine wanted to find some lyrics and the lack of proper verbatim mode has made it impossible to know if he had the wrong lyrics or if the information is not there or if the search itself is failing.
If there are no matches whatsoever then tell me there's no matches. If there's partial matches tell me how close it is to my search terms. Like you might match all but one or two words and so on. These are the kind of useful features I'd expect on search.
The usefulness of AI, on my mind, might be more towards interpretation of the questions rather than generation of the answers.
If I were Google I'd try something like using genAI to rephrase the question to extract keywords and so on that can be used to enhance search. But then again, I think I put myself in a position of "how do we make search better and more accurate" and that's simply not the position Google finds themselves in.
A friend of mine wanted to find some lyrics and the lack of proper verbatim mode has made it impossible to know if he had the wrong lyrics or if the information is not there or if the search itself is failing.
If there are no matches whatsoever then tell me there's no matches. If there's partial matches tell me how close it is to my search terms. Like you might match all but one or two words and so on. These are the kind of useful features I'd expect on search.
The usefulness of AI, on my mind, might be more towards interpretation of the questions rather than generation of the answers.
If I were Google I'd try something like using genAI to rephrase the question to extract keywords and so on that can be used to enhance search. But then again, I think I put myself in a position of "how do we make search better and more accurate" and that's simply not the position Google finds themselves in.
Google's results are now just plain baffling.
I live in India, haven't been to the US in 17 years, don't use a VPN.
Yet when I search for "St Petersburg Airport", it directs me to the airport for the city in Florida, and now the much older, much more densely populated, and much more culturally significant city in Russia (a city where I HAVE been once - and Google would likely know).
I live in India, haven't been to the US in 17 years, don't use a VPN.
Yet when I search for "St Petersburg Airport", it directs me to the airport for the city in Florida, and now the much older, much more densely populated, and much more culturally significant city in Russia (a city where I HAVE been once - and Google would likely know).
Yeah the other day I was browing the NYC central park website - https://www.centralpark.com/
And I noticed my 2021 Macbook was unable to scroll to the bottom of the page. It was just chugging like crazy, and I couldn't see the content I wanted because of it.
Then I remembered I didn't install AdBlock on this browser. I installed it and went back to the page, and OK now I can actually use the website.
---
What concerns me is not so much that there are lots of low quality sites looking to scrape pennies from Google or whatever.
It's that this kind of software development culture is normalized -- where government agencies and hospitals are sending data to Google and Facebook.
I would be interested to hear from somebody who works in those areas what the incentives are.
If you are working on the central park website, why are you adding ads to it? Isn't it funded by the government?
Specifically I opened up dev tools and I see like 297 blocked requests to
https://securepubads.g.doubleclick.net
I see ads for Lowe's Hardware Memorial Day sales and such. OK fine, but why are they locking up my computer and making the site unusable?
(Also does anyone remember the days when Google was "morally" against invasive image ads and irrelevant ads? They preached non-invasive and relevant, helpful ads. Those days seem SO far away now ...)
And I noticed my 2021 Macbook was unable to scroll to the bottom of the page. It was just chugging like crazy, and I couldn't see the content I wanted because of it.
Then I remembered I didn't install AdBlock on this browser. I installed it and went back to the page, and OK now I can actually use the website.
---
What concerns me is not so much that there are lots of low quality sites looking to scrape pennies from Google or whatever.
It's that this kind of software development culture is normalized -- where government agencies and hospitals are sending data to Google and Facebook.
I would be interested to hear from somebody who works in those areas what the incentives are.
If you are working on the central park website, why are you adding ads to it? Isn't it funded by the government?
Specifically I opened up dev tools and I see like 297 blocked requests to
https://securepubads.g.doubleclick.net
I see ads for Lowe's Hardware Memorial Day sales and such. OK fine, but why are they locking up my computer and making the site unusable?
(Also does anyone remember the days when Google was "morally" against invasive image ads and irrelevant ads? They preached non-invasive and relevant, helpful ads. Those days seem SO far away now ...)
It's still possible on Google to use Tools > All Results > Verbatim, and it won't extrapolate and try to find exact matches to the query.
>Honestly it's becoming impossible to find information on the web.
It's because everyone is trying to sell you something, no matter how irrelevant it is to you. The cost of transmitting information at scale is effectively zero, and gen AI makes generating information at scale also zero. It's noise at scale crowding out the non-scalable things that are of actual value to humans. Something has to give.
It's because everyone is trying to sell you something, no matter how irrelevant it is to you. The cost of transmitting information at scale is effectively zero, and gen AI makes generating information at scale also zero. It's noise at scale crowding out the non-scalable things that are of actual value to humans. Something has to give.
I don't think that's the only factor. There is a strong impetus toward obfuscation, both from the direction of a search engine (more clicks, more "interaction"), and from corporate & govt interests (the less people know, & know to be actually true, the better).
https://www.google.com/search?q=%22jridhxjiej%22
gives no matches for me, what does it show for you?
gives no matches for me, what does it show for you?
Your friend can still enclose the phrases of the lyrics with double quotes to force an exact match on each of them.
Now with verbatim if you have a typo they no longer show the number of results up front so you often don't notice and only get sources with the same typo, furthering the impression that Google's results suck.
"Google hides search results count under tools section"
https://searchengineland.com/google-hides-search-results-cou...
"Google hides search results count under tools section"
https://searchengineland.com/google-hides-search-results-cou...
Recent and related:
Google AI recommends adding Elmer's glue to pizza cheese after scanning Reddit - https://news.ycombinator.com/item?id=40448074 - May 2024 (122 comments)
Google AI recommends adding Elmer's glue to pizza cheese after scanning Reddit - https://news.ycombinator.com/item?id=40448074 - May 2024 (122 comments)
The end of the internet came sooner than expected. I wonder how long it took on alpha centurion.
It’s not obvious ‘attention is all you need’ would have been a public disclosure by a corporation in parallel worlds. Usually such inventions are buried.
It’s not obvious ‘attention is all you need’ would have been a public disclosure by a corporation in parallel worlds. Usually such inventions are buried.
Still I like Google, more than bing (copilot) or perplexity! I couldn't be where I am now without google
It went from search to making up utterly unusable dreck. It's not helpful, it's machine-generated nonsense that's more expensive to operate than search.
I'm not sure how this won't get worse.
It seems inevitable that LLMs will be training on more and more data generated by other LLMs creating a hallucination feedback loop.
It seems inevitable that LLMs will be training on more and more data generated by other LLMs creating a hallucination feedback loop.
Recursive garbage in, garbage out.
Saw this post on reddit today where google recommended jumping off the golden gate bridge
https://www.reddit.com/r/ChatGPT/comments/1czif9o/willing_to...
https://www.reddit.com/r/ChatGPT/comments/1czif9o/willing_to...
It occurs to me that I don't know who Alex Northstar is; he could quite simply be an AI creation as well. I now understand why the greybeard dream is to move to an off-grid cabin.
[deleted]
Reads like the Golden Gate Claude.
For all the halballoo about AI safety and laws, Google released it knowing very well about the hallucination.
Also it’s so prominent that you can’t even turn it off.
How is Google making money on this? It takes so much space, the ads are pushed down even further.
Also it’s so prominent that you can’t even turn it off.
How is Google making money on this? It takes so much space, the ads are pushed down even further.
FWIW those pull-out answers always were dubious. For instance Google has pulled out answers out of forum threads that were plain wrong, even the original poster conceded that in the thread later but Google just didn't get it.
It's not even hallucinating it's just correctly summarizing the wrong thing.
Also we're only talking about a handful of examples out of billions of queries, that doesn't stop the usual media hyperventilating though.
Also we're only talking about a handful of examples out of billions of queries, that doesn't stop the usual media hyperventilating though.
It only takes a reply to a handful of queries to get a handful of people actually hurt by telling them to do something dangerous.
The average person doesn't necessarily have the media and AI literacy to know not to trust papa google's answer at the top of the result page.
The average person doesn't necessarily have the media and AI literacy to know not to trust papa google's answer at the top of the result page.
Despite some evidence to the contrary I believe most people aren't that stupid and the "average person" isn't actually typing in these queries, these are marginal cases played out for meme value.
It highlights the underlying problem, which is that Google has built up trust over 20 years that they will return the best results from the web. Now they undermine that trust by shoving AI results at the top and calling it answers.
It doesn't take much imagination the think of non-meme questions that will propogate wrong information.
"Fake info from trusted sources" isn't a hypothetical issue. When they changed the law that required TV news to be factual we quickly headed down the path of Fox News and MSNBC. They are so effective precisely because Boomers grew up fully trusting news sources.
You can argue that it is not a problem and that people know the difference, but we have plenty of real-life proof to the contrary.
It doesn't take much imagination the think of non-meme questions that will propogate wrong information.
"Fake info from trusted sources" isn't a hypothetical issue. When they changed the law that required TV news to be factual we quickly headed down the path of Fox News and MSNBC. They are so effective precisely because Boomers grew up fully trusting news sources.
You can argue that it is not a problem and that people know the difference, but we have plenty of real-life proof to the contrary.
More consequential queries probably have better safeguards, this hullabaloo is about long tail nonsense that doesn't matter, they're kinks to be ironed out.
Google is imploding under AI
I'm surprised Google hasn't put AI on YouTube: "Feeling a bit down? Here, have some depressive suicidal black metal."
And this is why I subscribe to Kagi. They also have AI based summary, but you have to invoke it manually on a specific search result (in which case you know where the info is coming from).
I feel like we're on a race to the bottom. All of Silicon Valley and beyond have big FOMO on the AI hype train and any and all use of AI pleases investors. I guess we'll see how it all pans out in a few years.
One thing is for sure, generative AI and LLMs open up a whole can of worms in terms of disinformation and information noise on the Internet. The signal to noise ratio will greatly shift with these new initiatives.
I feel like we're on a race to the bottom. All of Silicon Valley and beyond have big FOMO on the AI hype train and any and all use of AI pleases investors. I guess we'll see how it all pans out in a few years.
One thing is for sure, generative AI and LLMs open up a whole can of worms in terms of disinformation and information noise on the Internet. The signal to noise ratio will greatly shift with these new initiatives.
Kagi is just too expensive for non US folks. The family plan costs more than my family's monthly wifi, netflix, and phone bills combined.
It also stings that I can't pay by PayPal, so not only would I have to pay the currency exchange margin to US Dollars but my bank also changes an out-of-currency fee.
I understand that they're probably focusing on US market growth first, but the UK and EU surely have potential too.
I understand that they're probably focusing on US market growth first, but the UK and EU surely have potential too.
Oh! That's at least one reason why people say they need to pay with PayPal. I've see people saying they won't buy things until PayPal was supported, but I couldn't figure it out for the longest time how anyone would be in a situation where paying with PayPal would be essential. Thanks for explaining that.
I can empathize with this. If not for my decent salary by European standards, I’m not sure I would prioritize paying for search when there are free options available.
It would be nice if more services used purchasing parity based pricing so more people could benefit.
It would be nice if more services used purchasing parity based pricing so more people could benefit.
No wonder these models weren't getting production attention and commercialized when they were invented...
I have been struggling to arrange lawn care for an out-of-state relative while they're incapacitated. While Google search populated some tables in its search results with a bunch of lawn care companies saying the address was in their service area, each and every company I contacted said it was not and asked where I got the info.
Visiting each company's site showed they didn't serve this town/address so it's really not clear how/why Google returned those results. In some cases the address was 20 miles from the nearest town served. Whether or not due to AI hallucination, or just general Googlenshittification - not a good result.
Visiting each company's site showed they didn't serve this town/address so it's really not clear how/why Google returned those results. In some cases the address was 20 miles from the nearest town served. Whether or not due to AI hallucination, or just general Googlenshittification - not a good result.
They could really just present it as what it is, a _search result_ summary, not an answer summary. Its not like searching for satirical comments should go away. As its presented now it feels very flawed but it doesn't need to be.
iLoveOncall(8)
That's a really weird and risky way of putting it.
There is a huge difference between being a search engine that finds (external) pages, and coming up with answers in your own name. If some page on the Internet says Obama is a Muslim, who cares, it's not important. But if Google says that Obama is in fact a Muslim, suddenly it's a very big deal. And that's true for every query, on every topic imaginable.
Every answer they get wrong attacks their image a little, and out of billions of queries it's inevitable they will get many wrong.
This forced, radical change motivated only by fear feels like Google+ all over again. Or New Coke.