> This is a search tool that will only return content created before ChatGPT's first public release on November 30, 2022.
The problem is that Google's search engine - but, oddly enough, ALL search engines - got worse before that already. I noticed that search engines got worse several years before 2022. So, AI further decreased the quality, but the quality had a downwards trend already, as it was. There are some attempts to analyse this on youtube (also owned by Google - Google ruins our digital world); some explanations made sense to me, but even then I am not 100% certain why Google decided to ruin google search.
One key observation I made was that the youtube search, was copied onto Google's regular search, which makes no sense for google search. If I casually search for a video on youtube, I may be semi-interested in unrelated videos. But if I search on Google search for specific terms, I am not interested in crap such as "others also searched for xyz" - that is just ruining the UI with irrelevant information. This is not the only example, Google made the search results worse here and tries to confuse the user in clicking on things. Plus placement of ads. The quality really worsened.
somebody said once we are mining "low-background tokens" like we are mining low-background (radiation) steel post WW2 and i couldnt shake the concept out of my head
(wrote up in https://www.latent.space/i/139368545/the-concept-of-low-back... - but ironically repeating something somebody else said online is kinda what i'm willingly participating in, and it's unclear why human-origin tokens should be that much higher signal than ai-origin ones)
Low background steel is no longer necessary.
"...began to fall in 1963, when the Partial Nuclear Test Ban Treaty was enacted, and by 2008 it had decreased to only 0.005 mSv/yr above natural levels. This has made special low-background steel no longer necessary for most radiation-sensitive uses, as new steel now has a low enough radioactive signature."
Interesting. I guess that analogously, we might find that X years after some future AI content production ban, we could similarly start ignoring the low background token issue?
We used a rather low number of atmospheric bombs, while we are carpet bombing the internet every day with AI marketing copy.
"Winter" in AI (or cryptocurrency, or any at all) ecosystems denote a period of low activity, and a focus on fundamentals instead of driven by hype.
What we're seeing now is something more like the peak of summer. If it ends up being a bubble, and it burtst, some months after that will be "AI Winter" as investors won't want to continue chucking money at problems anymore, and it'll go back to "in the background research" again, as it was before.
We instead entered eternal December.
We're bombing the internet into extinction. But we were way before AI. It got real bad during the SEO/monetization phase. AI was just the final nail.
We used a low number _and_ it was a while ago (it would be different if we used the same number spread out on the same time span)
What’s the half-life of a viral meme?
[dead]
Can't wait, in fifty years we will have our data clean again.
Since synthetic data for training is pretty ubiquitous seems like a novelty
that was me swyx
Multiple people have coined the idea repeatedly, way before you. The oldest comment on HN I could find was in December 2022 by user spawarotti: https://news.ycombinator.com/item?id=33856172
Here is an even older comment chain about it from 2020: https://news.ycombinator.com/item?id=23895706
Apparently, comparing low-background steel to pre-LLM text is a rather obvious analogy.
As well as that people often do think alike.
If you have a thought, it's likely it's not new.
Oh wow, great find! That’s really early days.
i didnt claim to invent it.
i claimed swyx heard it through me - which he did
you did!!
every human generation built upon the slop of the previous one
but we appreciated that, we called it "standing on the shoulders of giants"
> we called it "standing on the shoulders of giants"
We do not see nearly so far though.
Because these days we are standing on the shoulders of giants that have been put into a blender and ground down into a slippery pink paste and levelled out to a statistically typical 7.3mm high layer of goo.
The secret is you then have to heat up that goo. When the temperature gets high enough things get interesting again.
Just simulate some evolution here and there.
You get Flubber?
This sounds like an Alan Kay quote. He meant that in regards to useful inventions. AI-generated spam just decreases the quality. We'd need a real alternative to this garbage from Google but all the other search engines are also bad. And their UI is also horrible - not as bad as Google, but also bad. Qwant just tries to copy/paste Google for instance (though interestingly enough, sometimes it has better results than Google - but also fewer in general, even ignornig false positive results).
Deep Research reports I think are above average internet quality, they collect hundreds of sources, synthesize and contrast them & provide backlinks. Almost like a generative wikipedia.
I think all we can expect from internet information is a good description of the distribution of materials out there, not truth. This is totally within the capabilities of LLMs. For additional confidence run 3 reports on different models.
We have two optimization mechanisms though which reduce noise with respect to their optimization functions: evolution and science. They are implicitly part of "standing on the shoulders of giants", you pick the giant to stand on (or it is picked for you).
Whether or not the optimization functions align with human survival, and thus our whole existence is not a slop, we're about to find out.
That's because the things we built on weren't slop
Nothing conveys better the idea of a solid foundation to build upon than the word ‘slop’.
Every foundation needs some time to settle.
- Sir, this is an elevator.
You may have one point.
The industrial age was built on dinosaur slop, and they were giant.
How to make fire or kill a woolly mammoth was not slop come on.
There's a reason this is comedy:
Listen, lad. I built this kingdom up from nothing. When I started here, all there was was swamp. Other kings said I was daft to build a castle on a swamp, but I built it all the same, just to show 'em. It sank into the swamp. So, I built a second one. That sank into the swamp. So, I built a third one. That burned down, fell over, then sank into the swamp, but the fourth one... stayed up! And that's what you're gonna get, lad: the strongest castle in these islands.
[24] “Everyone then who hears these words of mine and does them will be like a wise man who built his house on the rock. [25] And the rain fell, and the floods came, and the winds blew and beat on that house, but it did not fall, because it had been founded on the rock. [26] And everyone who hears these words of mine and does not do them will be like a foolish man who built his house on the sand. [27] And the rain fell, and the floods came, and the winds blew and beat against that house, and it fell, and great was the fall of it.”
Capitalism, freedom of expression, the marketplace of ideas, democracy: at their best these things are ways to bend the wisdom of the crowds (such as it is) to the benefit of all; and their failures are when crowds are not wise.
The "slop" of capitalism is polluted skies, soil and water, are wage slaves and fast fashion that barely lasts one use, and are the reason why workplace health and safety rules are written in blood. The "slop" of freedom of expression includes dishonest marketing, libel, slander, and propaganda. The "slop" of democracy is populists promising everything to everyone with no way to deliver it all. The "slop" of the marketplace of ideas is every idiot demanding their own un-informed rambling be given the same weight as the considered opinions of experts.
None of these things contributed our social, technological, or economic advancement, they are simply things which happened at the same time.
AI has stuff to contribute, but using it to make an endless feed of mediocrity is not it. The flood of low-effort GenAI stuff filling feeds and drowning signal with noise, as others have said: just give us your prompt.
You can't build on slop because slop is a slippery slope
Maybe we'll have to slurp the slop so we don't slip on the slope.
[dead]
the only structure you can build with slop is a burial mound
What is unhardened concrete but slop?
it makes the sound of slop, but the similarity effectively ends there. you cant build an approvable heavy load bearing beam from slop but you can build a burial mound from both.
Because the pyramids, the theory of general relativity and the Linux kernel are all totally comparable to ChatGPT output. /s
Why is anybody still surprised that the AI bubble made it that big?
for every theory of relativity the is the religious non-sense and superstitions of the medieval ages or today
Well, "spooky action at a distance" is something that believing outright at the time, literally required faith - much like the faith required of scientist today, everything comes from nothing for no reason and without cause and as consequence - everything everywhere... Ohhh!!! and like 11 dimensions with maybe infinite universes, too -> oh yeah, and the universe is infinite, maybe.
They have so many ways of saying "God" without saying God.
If we have billions of AIs one might pick the correct learning materials. Same way human Einstein did.
I know we're just pointlessly abusing the analogy here, but... mediaeval cathedrals are a greater work of artifice than pyramids.
Somewhat related, the leaderboard of em-dash users on HN before ChatGPT:
https://www.gally.net/miscellaneous/hn-em-dash-user-leaderbo...
They should include users who used a double hyphen, too -- not everyone has easy access to em dashes.
That would false positive me. I have used double dashes to delimit quote attribution for decades.
Like this:
"You can't believe everything you read on the internet." -- Abraham Lincoln, personal correspondence, 1863
That's literally a standard use of em-dash being approximated by a double hyphen, though.
Does AI use double hyphens? I thought the point was to find who wasn't AI that used proper em dashes.
Anytime I do this — and I did it long before AI did — they are always em dashes, because iOS/macOS translates double dashes to em dashes.
I think there may be a way to disable this, but I don’t care enough to bother.
If people want to think my posts are AI generated, oh well.
What, no love for our friend the en-dash?
- vs – vs —
I cannot remember ever reading a book where there was a space around the dashes.
There is also the difference in using space around em-dashes.
Oof, I feel like you'll accidentally capture a lot of getopt_long() fans. ;)
Excluding those with asymmetrical whitespace around might be enough
Double-hyphen is an en-dash. Triple-hyphen is an em-dash.
Double hyphen is replaced in some software with an en-dash (and in those, a triple hyphen is often replaced with an em-dash), and in some with an em-dash; its usually used (other than as input to one of those pieces of software) in places where an em-dash would be appropriate, but in contexts where both an em-dash set closed and an en-dash set open might be used, it is often set open.
So, it’s not unambiguously s substitute for either is essentially its own punctuation mark used in ASCII-only environments with some influence from both the use of em-dashed and that of en-dashes in more formal environments.
I have used a dash - like that for almost 20 years, 100% of the time I ought to use a semi-colon and about half of the time for commas - it let's me just keep talking about things, the comma is harder pause. I've recently started seriously writing at a literary level, and I have fallen in love with the em dash - it has a fantastic function within established professional writing, where it is used often - its why the AI uses it so much.
Apparently, it's not only em-dash that's distinctive. I've went through comments of the leader, and spot he also uses the backtick "’" instead of the apostrophe.
I (~100 in the leaderboard, regardless of how you sort) also frequently use ’ (unicode apostrophe) instead of ' :D
Just to be clear this is done automatically by macOS or iOS browsers when configured properly.
Never happened to me. And I'm using Mac and iPhone.
Amazing! But no love for en dashes?
Projects like this remind me of a plot point in the Cyberpunk 2077 game universe. The "first internet" got too infected with dangerous AIs, so much so that a massive firewall needed to be built, and a "new" internet was built that specifically kept out the harmful AIs.
(Or something like that: it's been awhile since I played the game, and I don't remember the specific details of the story.)
It makes me wonder if a new human-only internet will need to be made at some point. It's mostly sci-fi speculation at this point, and you'd really need to hash out the details, but I am thinking of something like a meatspace-first network that continually verifies your humanity in order for you to retain access. That doesn't solve the copy-paste problem, or a thousand other ones, but I'm just thinking out loud here.
The problem really is that it is impossible to verify that the content someone uploads came from their mind and not a computer program. And at some point probably all content is at least influenced by AI. The real issue is also not that I used chatgpt to look up a synonym or asked a question before writing an article, the problem is when I copy paste the content and claim I wrote it.
The solution is not to be able to upload content. Extremely dumb services, basic trusted information sharing. Just like a newspaper.
> The problem really is that it is impossible to verify that the content someone uploads came from their mind and not a computer program.
Er...digital id.
Ignoring the privacy and security issues for a moment, how would having a digital ID prove that the blog post I put on my site came only out of my own mind and I didn't use an LLM for it?
There doesn't need to be any difference in treatment between AI slop and human slop. The point isn't to keep AI out - it's to keep spam and slop out. It doesn't matter whether it's produced by a being made of carbon or silicon.
If someone can consistently produce high-quality content with AI assistance, so be it. Let them. Most don't, though.
I think the main issue is that when content is hand written you can be certain someone put at least the effort it takes to write into it. And while some people write fast, I would assume that at least means they have read their own writing once.
AIslop you can produce faster than you're able to read it. This makes it incredibly costly to filter out in comparison. It just messes so much with the signal to noise ratio on the web.
Bring AI-written is a proxy for being spam. Almost all AI-written content is spam and that's why it's bad.
> the problem is when I copy paste the content and claim I wrote it
Why is this the problem and not the reverse - using AI without adding anything original into the soup? I could paraphrase an AI response in my own words and it will be no better. But even if I used AI, if it writes my ideas, then it would not be AI slop.
> And at some point probably all content is at least influenced by AI.
[citation needed]
(I see absolutely no reason why that should be the case)
The issue is most things being derivative along with AI now representing an increasing share of "most things" from which to derive from.
[flagged]
I share an opinion with Nick Bostrom, once a civilization disrupting idea (like LLMs) is pulled out of the bag, there is no putting it back. People in isolation will recreate it simply because it's now possible. All we can do is adapt.
That being said, the idea of a new freer internet is reality.. Mastodon is a great example. I think private havens like discord/matrix/telegram are an important step on the way.
how does one keep ai out of private havens? thorough verification? is that the future? private havens on platforms?
In person web of trust in order to join any private community. It'll suck and be hard in the beginning, but once you reach a threshold, it'll be OK. Ban entire trees of users when you discover bots/puppets, to set an example.
Yep and then you deperson them
If you play it again, make sure not to miss the Blackwall gateway quickhack:
https://cyberpunk.fandom.com/wiki/Blackwall_Gateway
Absolutely brutal: https://www.youtube.com/watch?v=LD5z3GmQRXQ
---
I also noticed how simple the "new web" is when interacting with it. Of course, that's a game mechanic, but also kinda makes sense.
It's a shame that the Militech Canto only has 4 quickhack slots
Arguably this is already happening with much human-to-human interactions moving to private groups on Signal, WhatsApp, Telegram, etc.
There were also similar plot points mentioned in Peter Watts' Starfish trilogy, and Neal Stephenson's Anathem.
> a new human-only internet
Only if those humans don't take their leads from AI. If they read AI and write, not much benefit.
besides for training future models, is this really such a big deal? most of the AI-gened text content is just replacing content-farm SEO-spam anyway. the same stuff that any half-awares person wouldn't have read in the past is now slightly better written, using more em dashes and instances of the word "delve". if you're consistently being caught out by this stuff then likely you need to improve your search hygiene, nothing so drastic as this
the only place I've ever had any issue with AI content is r/chess, where people love to ask ChatGPT a question and then post the answer as if they wrote it, half the time seemingly innocently, which, call me racist, but I suspect is mostly due to the influence of the large and young Indian contingent. otherwise I really don't understand where the issue lies. follow the exact same rules you do for avoiding SEO spam and you will be fine
In the past, I'd find one wrong answer and I could easily spot the copies. Now there's a dozen different sites with the same wrong answer, just with better formatting and nicer text.
The trick is to only search for topics where there are no answers, or only one answer leading to that blog post you wrote 10 years ago and forgot about.
A colleague sent me a confident ChatGPT formatted bug report.
It misidentified what the actual bug was.
But the tone was so confident, and he replied to my later messages using chat gpt itself, which insisted I was wrong.
I don't like this future.
Did you call his ass out for being lazy and wasting your time?
I have dozens of these over the years - many of the people responsible have "Head of ..." or "Chief ..." job titles now.
It's not the future. Tell him not to do that. If it happens again, bring it to the attention of his manager. Because that's not what he's being paid for. If he continues to do it, that's grounds for firing.
What you're describing is not the future. It's a fireable offense.
> the only place I've ever had any issue with AI content is r/chess, where people love to ask ChatGPT a question and then post the answer as if they wrote it, half the time seemingly innocently
Some of the science, energy, and technology subreddits receive a lot of ChatGPT repost comment. There are a lot of people who think they’ve made a scientific or philosophical breakthrough with ChatGPT and need to share it with the world.
Even the /r/localllama subreddit gets constant AI spam from people who think they’ve vibecoded some new AI breakthrough. There have been some recent incidents where someone posted something convincing and then others wasted a lot of time until realizing the code didn’t accomplish what the post claimed it did.
Even on HN some of the “Show HN” posts are AI garbage from people trying to build portfolios. I wasted too much time trying to understand one of them until I realized they had (unknowingly?) duplicated some commits from upstream project and then let the LLM vibe code a README that sounded like an amazing breakthrough. It was actually good work, but it wasn’t theirs. It was just some vibecoding tool eventually arriving at the same code as upstream and then putting the classic LLM written, emoji-filled bullet points in the README
Yes it is a big deal. I cant find new artists without having a fear of their art being AI generated, same for books and music. I also cant post my stuff to the internet anymore because I know its going to be fed into LLM training data. The internet is dead to me mostly and thankfully I lost almost all interest of being on my computer as much as I used to be.
> besides for training future models, is this really such a big deal? most of the AI-gened text content is just replacing content-farm SEO-spam anyway.
Yes, it is because of the other side of the coin. If you are writing human-generated, curated content, previously you would just do it in your small patch of Internet, and probably SEs (Google...) will pick it up anyway because it was good quality content. You just didn't care about SEO-driven shit anyway. Now you nicely hand-written content is going to be fed into LLM training and it's going to be used - whatever you want it or not - in the next generation of AI slop content.
It's not slop if it is inspired from good content. Basically you need to add your original spices into the soup to make it not slop, or have the LLM do deep research kind of work to contrast among hundreds of sources.
Slop did not originate from AI itself, but from the feed ranking Algorithm which sets the criteria for visibility. They "prompt" humans to write slop.
AI slop is just an extension of this process, and it started long before LLMs. Platforms optimizing for their own interest at the expense of both users and creators is the source of slop.
this is basically the equivalent of saying that content-farm writers might read your content and bastardise it into seo slop. okay, sure, it's true, but it was always true and AI doesn't change it significantly
SEO-spam was often at least somewhat factual and not complete generated garbage. Recipe sites, for example, usually have a button that lets you skip the SEO stuff and get to the actual recipe.
Also, the AI slop is covering almost every sentence or phrase you can think of to search. Before, if I used more niche search phrases and exact searches, I was pretty much guaranteed to get specific results. Now, I have to wade through pages and pages of nonsense.
Yes indeed, it is a problem. Now the old good sites have turned into AI-slop sites because they can't fight the spammers by writing slowly with humans.
if a potential defense is to simply the spammers, then the site was previously just as likely to start hiring content-farm human slop writers as they are now likely to use AI, i.e. the site probably wasn't that great in the first place and had equal potential to deteriorate, AI or no
The low-background steel of the internet
As mentioned half a year ago at https://news.ycombinator.com/item?id=44239481
As mentioned 7 months ago https://news.ycombinator.com/item?id=43811732
As mentioned in this thread :P https://news.ycombinator.com/item?id=46103662
You don’t need an extension to do this. Simply add a “before:” search filter to your search query, eg - https://www.google.com/search?q=Happiness+before%3A2022
The other day I was researching with ChatGPT.
* ChatGPT hallucinated an answer
* ChatGPT put it in my memory, so it persisted between conversations
* When asked for a citation, ChatGPT found 2 AI created articles to back itself up
It took a while, but I eventually found human written documentation from the organization that created the technical thingy I was investigating.
This happens A LOT for topics on the edge of knowledge easily found on the Web. Where you have to do true research, evaluate sources, and make good decisions on what you trust.
AI reminds me of combing through stackoverflow answers. The first one might work... Or it might not. Try again, find a different SO problem and answer. Maybe third times the charm...
Except it's all via the chat bot and it isn't as easy to get it to move off of a broken solution.
Simple solution - run the same query on 3 different LLMs with different search integrations, if they concur chances of hallucination are low.
Ultimately, once I had a spidey sense something was wrong I double checked ChatGPT using Claude
Or you could just… not use LLMs
Or they've converged on the same bullshit
For images, https://same.energy is a nice option that, being abandoned but still functioning since a few years, seems to naturally not have crawled any AI images. And it’s all around a great product.
Why use this when you can use the before: syntax on most search engines?
doesn't actually do anything anymore in Google or bing.
Searching Google for
chatgpt
vs
chatgpt before:2022-01-01
give me quite different results. In the 2nd query, most results have a date listed next to them in the results page, and that date is always prior to 2022. So the date filtering is "working". However, most of the dates are actually Google making a mistake and misinterpreting some unimportant date it found on the page as the date the page was created. At least one result is a Youtube video posted before 2022, that edited its title after Chatgpt was released to say Chatgpt.
Disclosure: I work at Google, but not on search.
I use it frequently to find older websites to browse. Works relatively well for most search terms. If you want something from 2005 or before I find -inurl:https works well.
Most of college courses and school books haven't changed in decades. Some reputed college keep courses for Pascal and Fortran instead of Python or Java, just because, it might affect their reputation of being classical or pure or to match their campus buildings style.
Or because the core knowledge stay the same no matter how it is expressed.
FWIW Mojeek (an organic search engine in the classic sense) can do this with the before: operator.
https://www.mojeek.com/search?q=britney+spears+before%3A2010...
google results were already 90% SEO crap long before ChatGPT
just use Kagi and block all SEO sites...
How do we (or Kagi) know which ones are "SEO sites"? Is there some filter list or other method to determine that?
If you took Google of 2006, and used that iteration of the pagerank algorithm, you’d probably not get most of the SEO spam that’s so prevalent in Google results today.
It seems like a mixture of heuristics, explicit filtering and user reports.
https://help.kagi.com/kagi/features/slopstop.html
That's specifically for AI generated content, but there are other indicators like how many affiliate links are on the page and how many other users have downvoted the site in their results. The other aspect is network effect, in that everyone tunes their sites to rank highly on Google. That's presumably less effective on other indices?
You should call it Predecember, referring to the eternal December.
September?
ChatGPT was released exactly 3 years ago (on the 30th of November) so December it is in this context.
surely that would be eternal November then
oof I only caught the meaning of this on the third read. depressing
In the end the analogy doesn't really work, because 'eternal September' referred to what used to be a regular, temporary thing (an influx of noobs disrupting the online culture, before eventually leaving or assimilating) becoming the new normal. 'Eternal {month associated with ChatGPT}' doesn't fit because LLM-generated content was never a periodic phenomenon.
to be honest, GPT-3, which was pretty solid and extremely capable of producing webslop, had been out for a good while before ChatGPT, and GPT-2 even had been being used for blogslop years before. maybe ChatGPT was the beginning of when the public became aware of it, but it was going on well beforehand. and, as the sibling commenter points out, the analogy doesn't quite fit structurally either
Yes, and this site is for everything before the slop era, hence eternal November.
aka 0 December
How about a search engine that only returns what you searched for, and not a million other unrelated things that it hopes you might like to buy?
This goes for you, too, website search.
Does this filter out traditional SEO blogfarms?
Yeah, might prefer AI-slop to marketing-slop.
They are the same. I was looking for something and tried AI. It gave me a list of stuff. When I asked for its sources, it linked me to some SEO/Amazon affiliate slop.
All AI is doing is making it harder to know what is good information and what is slop, because it obscures the source, or people ignore the source links.
I've started just going to more things in person, asking friends for recommendations, and reading more books (should've been doing all of these anyway). There are some niche communities online I still like, and the fediverse is really neat, but I'm not sure we can stem the Great Pacific Garbage Patch-levels of slop, at this point. It's really sad. The web, as we know and love it, is well and truly dead.
I don't know how this works under the hood but it seems like no matter how it works, it could be gamed quite easily.
True, but there's probably many ways to do this and unless AI content starts falsifying tons of its metadata (which I'm sure would have other consequences), there's definitely a way.
Plus other sites that link to the content could also give away it's date of creation, which is out of the control of the AI content.
I have heard of a forum (I believe it was Physics Forums) which was very popular in the older days of the internet where some of the older posts were actually edited so that they were completely rewritten with new content. I forget what the reasoning behind it was, but it did feel shady and unethical. If I remember correctly, the impetus behind it was that the website probably went under new ownership and the new owners felt that it was okay to take over the accounts of people who hadn't logged on in several years and to completely rewrite the content of their posts.
I believe I learned about it through HN, and it was this blog post: https://hallofdreams.org/posts/physicsforums/
It kind of reminds me of why some people really covet older accounts when they are trying to do a social engineering attack.
> website probably went under new ownership
According to the article, it was the founder himself who was doing this.
If it's just using Google search "before <x date>" filtering I don't think there's a way to game it... but I guess that depends on whether Google uses the date that it indexed a page versus the date that a page itself declares.
Date displayed in Google Search results is often the self-described date from the document itself. Take a look at this "FOIA + before Jan 1, 1990" search: https://www.google.com/search?q=foia&tbs=cdr:1,cd_max:1/1/19...
None of these documents were actually published on the web by then, incl., a Watergate PDF bearing date of Nov 21, 1974 - almost 20 years before PDF format got released. Of course, WWW itself started in 1991.
Google Search's date filter is useful for finding documents about historical topics, but unreliable for proving when information actually became publicly available online.
Are you sure it works the same way for documents that Google indexed at the time of publication? (Because obviously for things that existed before Google, they had to accept the publication date at face value).
Interesting, thanks.
I wonder why they do that when they could use time of first indexing instead.
"Gamed quite easily" seems like a stretch, given that the target is definitionally not moving. The search engine is fundamentally searching an immutable dataset that "just" needs to be cleaned.
How? They have an index from a previous date and nothing new will be allowed since that date? A whole copy of the internet? I don't think so.... I'm guessing, like others, it's based on the date the user/website/blog lists in the post. Which they can change at any time.
Yes they do. It's called common crawl, and is available from your chosen hyperscaler vendor.
Just the other evening, as my family argued about whether some fact was or was not fake, I detached from the conversation and began fantasizing about whether it was still possible to buy a paper encyclopedia.
I didn’t know “eccentric engineering” was even a term before reading this. It’s fascinating how much creativity went into solving problems before large models existed. There’s something refreshing about seeing humans brute force the weird edges of a system instead of outsourcing everything to an LLM.
It also makes me wonder how future kids will see this era. Maybe it will look the same way early mechanical computers look to us. A short period where people had to be unusually inquisitive just to make things work.
Maybe like how I view my dad and the punchcard era: cool and endearing that he went through that, but thankful that I don’t have to.
I'm grateful that I published a large body of content pre-ChatGPT so that I have proof that I'm not completely inarticulate without AI.
If I want dead information I'll go find a newspaper. This is kind of silly. Even if AI rewrites the entire internet - we aren't going to live in a time capsule.
Plus, the AI already read everything made before 2023, so what does it matter?
Creatives need to think a bit bigger with this particular issue.
ChatGPT also returns content only created before ChatGPT release, which is why I still have to google damn it!
Click the globe icon below the input box to enable web searching by ChatGPT.
Is that still the case? And even if so how is it going to avoid keeping it like that in the future? Are they going to stop scraping new content, or are they going to filter it with a tool which recognizes their own content?
it's a known problem in ML, I think grok solved it partially and chatGPT uses another model on top to search web like suggested below. Hence MLOps field appeared, to solve models management
I find it a bit annoying to navigate between hallucinations and outdated content. Too much invalid information to filter out.
It doesn't really work. I tried my website and it shows up, while definitely being built after 2023. There is a mistake in the metadata of the page that shows it as from 2011.
I noticed AI-generated slop taking over google search results well before ChatGPT. So I don't agree with the premise on this site that you can be "you can be sure that it was written or produced by the human hand."
Not affiliated, but I've been using kagi's date range filter to similar effect. The difference in results for car maintenance subjects is astounding (and slightly infuriating).
I hope there's an uncensored version of the Internet Archive somewhere, I wish I could look at my website ca. 2001, but I think it got removed because of some fraudulent DMCA claim somewhere in the early 2010s.
> This is a search tool that will only return content created before ChatGPT's first public release on November 30, 2022.
How does it do that? At least Google seems to take website creation date metadata at face value.
The slop is getting worse, as there is so much llm generated shit online, now new models are getting trained on the slop. Slop training slop, and slop. We have gone full circle just in a matter of a few years.
I was replaying Cyberpunk 2077 and trying to think of all the ways one might have dialed up the dystopia to 11 (beyond what the game does). And pervasive AI slop was never on my radar. Kinda reminds me of the foreword in Neuromancer bringing attention to the fact the book was written before cellphones became popular. It's already fucking with my mind. I recently watched Frankenstein 2025 and 100% thought gen ai had a role in the CGI only to find out the director hates it so much he rather die than use it. I've been noticing little things in old movies and anime where I thought to myself (if I didn't know this was made before gen ai, I would have thought this was generated for sure). One example (https://www.youtube.com/watch?v=pGSNhVQFbOc&t=412) cityscape background in this a outro scene with buildings built on top of buildings gave me ai vibes (really the only thing in this whole anime), yet this came out ~1990. So I can already recognize a paranoia / bias in myself and really can't reliably tell what's real.. Probably also other people have this and why some non-zero number of people always thinks every blog post that comes out was written by gen ai.
I had the same experience, watching a nature documentary on a streaming service recently. It was... not so good, at least at the beginning. I was wondering if this was a pilot for AI generated content on this streaming service.
Actually, it came out in 2015 and was just low budget.
This is an imperfect search extension.
It's a hell of a lot better than nothing, if one is using chrome or Firefox (neither of which are my primary browsers).
For a while I've been saying it's a pity we hadn't been regularly trusted-timestamping everything before that point as a matter of course.
What kind of heuristics does it use to determine age? a lot of content on Google actually backdates for some reason... presumably some sort of SEO scam?
For that purpose I do not update my book on LeanPub about Ruby. I just know one day people gonna read it more, because human-written content would be gold.
I really thought this was going to be the Dewey Decimal system. Exclude sources from this century. It’s the only way to be sure.
Of course my first thought was: Let's use this as a tool for AI searches (when I don't need recent news).
Can't we just append "before:2021-01-01" to Google?
I use this to find old news articles for instance.
Something generated by humans does not mean high quality.
Yes, but AI-generated is always low quality so it makes sense to filter it out.
Grokipedia would like a word
I wouldn't say always... Especially because you probably only noticed the bad slop. Usually it is crap though.
At least when reading a human-made material you can spot author's uncertainty in some topics. Usually, when someone doesn't have knowledge of something, he doesn't try to describe that. AI, however, will try to convince you that pigs can fly.
[dead]
The real gold is content created before the internet!
In hindsight, that would've been a real utility use case for NFTs. A decentralized cryptographic prove that some content existed in a particular form at a particular moment.
This tool has no future. We have that in common with it, I fear.
What we really need to do is build an AI tool to filter out the AI automatically. Anybody want to help me found this company?
technically you can ask chatgpt to return the same result by asking it to filter by year
so it's a filter by date and you chose the chatgpt's public release?
This is such a great idea
Interesting concept. As a side benefit this would allow you to make steady progress fighting SEO slop as well, since there can be no arms race if you are ignoring new content.
You could even add options for later cutoffs… for example, you could use today’s AIs to detect yesterday’s AI slop.
"This browser extension uses the Google search API to only return content published before Nov 30th, 2022 so you can be sure that it was written or produced by the human hand."
low-background information
I mean I get it, but it seems a bit silly. What's next - an image search engine that only returns images created before photoshop?
We now need an extension to hide 3 years of the internet because it was written by robots. This timeline is undefeated.
[dead]
[dead]
[dead]
[dead]
[dead]
[flagged]
Is it really here to stay? If the wheels fells off the investment train and ChatGPT etc. disappeared tomorrow, how many people would be running inference locally? I suspect most people either wouldn't meet the hardware requirements or would be too frustrated with the slow token generation to bother. My mom certainly wouldn't be talking to it anymore.
Remember that a year or two ago, people were saying something similar about NFTs —that they were the future of sharing content online and we should all get used to it. Now, they still might exist, it's true, but they're much less pervasive and annoying than they once were.
Maybe you don't love your mom enough to do this, but if ChatGPT disappeared tomorrow and it was something she really used and loved, I wouldn't think twice before buying her a rig powerful enough to run a quantized downlodable model on, though I'm not current on which model or software would be the best for her purposes. I get that your relationship with your mother, or your financial situation might be different though.
> Maybe you don't love your mom enough to do this
I actually love my mom enough not to do this.
Maybe you should talk more to your mother so she does not need a imaginary friend.
Please tell me this is satire.
No man, this must be satire.
> I get that your relationship with your mother, or your financial situation might be different though.
Fucking hell
>that they were the future of sharing content online
nobody was saying that
People right here on HN were adamant my next house would be purchased using an NFT. And similar absurd claims about blockchain before that.
And it's at least interesting that it's a lot of the same people pitching AI now who were all so excited about blockchain and NFTs and the metaverse.
I don't agree it is 'almost worse' than the slop but it sure can be annoying. On one hand it seems even somewhat positive that some people developed a more critical attitude and question things they see, on the other hand they're not critical enough to realize their own criticism might be invalid. Plus I feel bad for all the resources (both human and machine) wasted on this. Like perfectly normal things being shown, but people not knowing anything about the subject chiming in to claim that it must be AI because they see something they do not fully understand.
My main exposure to this was just in a couple of online social communities.
1. AI happens 2. Every response (that are often memes in themselves), is complaining about the AI. Hell, some of them were clever in the way a brand new meme template was in 2015. 3. Memeing about the AI happens to the point where a few borderline freaking death threats start sneaking in. 4. Someone posts thoughtful original content, the whole place degrades into a “thank god it’s not AI” meme.
Or, let’s fragment our already tiny community into NO AI SLOP
I’ve seen this exact thing happen in three very niche communities.
"You know what's almost worse than something bad? People complaining about something bad."
Shrug. Sure.
Point still stands. It’s not going anywhere. And the literal hate and pure vitriol I’ve seen towards people on social media, even when they say “oh yeah; this is AI”, is unbelievable.
So many online groups have just become toxic shitholes because someone once or twice a week posts something AI generated
This kind of pressure is good actually, because it helps fighting against “lazy AI use” while letting people use AI in addition to their own brain.
And that's a hood thing because I much as I like LLMs as a technology, I really don't want people blindly copy-pasting stuff from it without thinking.
The entire US GDP for the last few quarters is being propped up by GPU vendors and one singular chatbot company, all betting that they can make a trillion dollars on $20-per-month "it's not just X, it's Y" Markov chain generators. We have six to 12 more months of this before the first investor says "wait a minute, we're not making enough money", and the house of cards comes tumbling down.
Also, maybe consider why people are upset about being consistently and sneakily lied to about whether or not an actual human wrote something. What's more likely: that everyone who's angry is wrong, or that you're misunderstanding why they're upset?
Fascinatingly, as we found out from this HN post Markov chains don't work when scaled up, for technical reasons, so that whole transformers thing is actually necessary for this current generation of AI.
> I dare you to try building a project with Cursor or a better cousin and then come back and repeat this comment
I always try every new technology, to understand how it works, and expand my perspective. I've written a few simple websites with Cursor (one mistake and it wiped everything, and I could never get it to produce any acceptable result again), tried writing the script for a YouTube video with ChatGPT and Claude (full of hallucinations, which – after a few rewrites – led to us writing a video about hallucinations), generated subtitles with Whisper (with every single sentence having at least some mistake) and finally used Suno and ChatGPT to generate some songs and images (both of which were massively improved once I just made them myself).
Whether Android apps or websites, scripts, songs, or memes, so far AI is significantly worse at internet research and creation than a human. And cleaning up the work AI did always ended up being taking longer just doing it myself from scratch. AI certainly makes you feel more productive, and it seems like you're getting things done faster, even though it's not.
What isn't going anywhere? You're kidding yourself if you think every single place AI is used will withstand the test of time. You're also kidding yourself if you think consumer sentiment will play no part in determining which uses of AI will eventually die off.
I don't think anyone seriously believes the technology will categorically stop being used anytime soon. But then again we still keep using tech thats 50+ years old as it is.
[flagged]
Besides this being spam, the linked leaderboard is pre-chatgpt, it doesnt care about comments made now
[flagged]
Are you aware of Kagi (kagi.com)?
With them, at least the AI stuff can be turned off.
Membership is presently about 61k, and seems to be growing about 2k per month: https://kagi.com/stats
Be aware of:
https://www.reddit.com/r/SearchKagi/comments/1gvlqhm/disappo...
I directly use Yandex sometimes, because there are huge blind spots for all the US-based engines I'm aware of, and it fills some of them in.
If someone can point me to a better index for that purpose, I'd love to avoid Yandex. Please inform me.
There are few other powerful countries, with countless Web services, who freely wages war(s) on other countries and support wars in many different ways. Is there a way to avoid their products?
As a European, I'm also increasingly in favour of avoiding American companies. Especially the big corrupting near-monopolists.
It's worth pointing out the flaws of all bad actors. The more info we have, the more effectively we can act.
Why this particular stand? Is doing nothing any better than taking what are essentially random stands? Obviously if you are Ukrainian this will be an important stand to you, but otherwise doing things based on a mix of what the media you like focuses on or whatever is not really very different from doing nothing.
I was very conscious of this comment being called out as a 'whatabout', it was still only thing I could think of and wrote it bit carefully.
My point was that we should either not take an issue with things like this and block everything in the whole country because their government is bad. Or we should do the same for other countries too.
Google is worse than Yandex, no? At this time, Russia is (debatably*) more evil than the USA, but that doesn't mean Yandex is more evil than Google. And I'm told Yandex has better search results.
* most of the evil stuff Russia's done, the USA's done way more of
Not only is "whataboutism" literally anti-communist jargon, you're using it wrong. It was meant to refer to when the US would criticize some aspect of the USSR and the USSR would point to the fact that the US was an apartheid state. The point was that the accusation that the US was making was entirely different from the observation that the USSR was making - it was simply a change of subject.
You can't call for a boycott on a cosmetics company that experiments on dogs if you are a rival cosmetics company that experiments on ten times as many dogs.
“whataboutism” is the reddit word for calling out hypocrisy
Imo, Kagi is still the better option, because it isn't supporting the global surveillance mechanism we call advertising. All these people, missing the forest for the single yandex tree.
I find this amusing, because it seems like Kagi's target audience dislikes this (politically polarized), and I as someone who is not Kagi's target audience likes this (politically neutral).
Because when Ferret7446 says "neutral", they mean "anything that doesn't harm them". Centrism is a lie.
Same reason supporting Google, Microsoft, YCombinator is a neutral decision.
Kagi uses both Yandex and Google btw.
Solution: Kagi as it is, but with a ‘remove Yandex’ toggle. Even if it was a paid upgrade, I’d take it.
Yeah, it's two dimensional. One axis goes from good to evil. The other axis, chaotic to lawful.
Wait, what? Their choice is specifically a politically neutral one, wouldn't that mean their target audience is a politically neutral one? Why is your impression that Kagi's target audience is politically polarized users? Been a paying user of Kagi for years, never got that impression.
FWIW, I don't think Kagi should remove or avoid indexing content from countries that invade others, because a lot of the times websites in those countries have useful information on them. If Kagi were to enact such a block, it would mean it would no longer surface results from HN, reddit and a bunch of other communities, effectively making the search engine a lot less useful.
Why's that something to be aware of? Yandex is actually a good search engine, so I'm told, as long as you don't search for things related to Russian politics. Kagi presumably knows this and won't use their results related to Russian politics.
Feels more like a scare campaign to me - someone doesn't want you to use Kagi, and points to Yandex as a reason for that.
Kagi is based in the United States, as is YC.
If you are concerned about heinous war crimes and the slaughter of civilians to the point that you don't want to use private services from countries that conduct such acts, you should avoid both already.
Yandex has the best image search, and others are years behind it. Further more Nebius has sold all group’s businesses in Russia and certain international market. They are completely divested from Russia for a 1.5 years already: https://nebius.com/newsroom/ynv-announces-successful-complet...
The post you linked was posted when the divestment was already going underway, so it is at least dishonest if not malicious.
Some clarification. Since 2024 Yandex NV split into Nebius (NL-registred NASDAQ-listed company, no longer a search engine) and russian-based Yandex. The latter is fully controlled by russian investors.
The government's where the offices of a software company are physically located exert control over them. To follow this logic to its end and apply it even handedly results in nation based NIH syndrome surely?
You are mistaken to think that zealots can be reasoned with. They have been conditioned to react upon anything “Russia” like a Pavlovian cue, a command of the trained animal. They are a herd that moves as a herd, based on cues of lead animals. No amount of proof or evidence will ever dissuade them from a position that the herd is moving in. They cannot reason on their own and lack the courage to separate, let alone say something that the herd disapproves of, lest they be expelled from the herd and ganged up on.
https://news.ycombinator.com/item?id=42349797 (11 months ago)
https://som.yale.edu/story/2022/over-1000-companies-have-cur...
You pays your money, you takes your choice.
You don't "trust" a divorce is alimony was part of the settlement?
I don't like defending Russia which is a horrible country, but I find it hypocritical to only talk about their imperialism and pretend not to see that the most imperialist country in the world, the one that has started, financed, and participated in the most wars, is the United States, and yet the question of boycotting American companies is never brought up. Google has been intentionally sabotaged in terms of image search and reverse image search; Yandex is literally the best on the market, but Kagi should boycott them because their headquarters are in the wrong country?
Damn. I didn't know that.
Now we need a 2nd Kagi, so we can switch to that one instead. :(
Yeah I kept thinking "man I should try kagi" and then that :(
Naw, the well is poisoned and I question the company's decision making at this point.
He probably doesn’t want to support genocide.
I don't agree with this logic. It implies that people who use Google, Bing and a million other products made by US-based companies are supportive of the huge amount of attrocities commited or aided by the United States. Or other countries. It feels very odd to single out Russia's invasion of Ukraine but to minimize the Israeli genocide of palestinians in Gaza, the multiple unjust wars waged by the United States all over the world etc.
It's often fairly easy to find US government-centric news and criticism with Google.
But as one counterexample: The end of the US penny was formed and announced not with public legislative discourse, nor even with an executive order, but with a brief social media post by the president.
And I don't mean that it's atrocious or anything, but I wanted to see that social media post myself. Not a report about it, or someone's interpretation of it, but -- you know -- the actual utterance from the horse's mouth.
Which should be a simple matter. After all, it's the WWW.
And I've been Googling for as long as there has been a Google to Google with. I'd like to think that I am proficient at getting results from it.
But it was like pulling teeth to get Google to eventually, kicking and screaming, produce a link to the original message on Truth Social.
If that kind of active reluctance isn't censorship on Google's part, then what might it be described as instead?
And if they're seeking to keep me away from the root of this very minor issue, then what else might they also be working to keep me from?
I have yet to see any kind of censorship when querying Yandex, do you have any examples?
Not overtly - and not all of the things the US as a whole may want.
But Google does censor.
It doesn’t imply any of that at all.
There certainly is a huge army of people ready to spout this sort of nonsense in response to anyone talking about doing anything.
Hard to know what percentage of these folks are trying to assuage their own guilt and what percentage are state actors. Russia and Israel are very chronically online, and it behooves us internet citizens to keep that in mind.
I'm surprised this is possible given the sanctions on Russia.
So if America invades Venezuela should we all stop using google? Should we have stopped using google when the U.S. invaded Iraq and killed 150,000 people[1]?
Should we stop using products imported from China for the cultural genocide they've perpetrated against the Uyghurs?[2]
Is Yandex Russia?
[1] https://en.wikipedia.org/wiki/Casualties_of_the_Iraq_War
[2] https://en.wikipedia.org/wiki/Persecution_of_Uyghurs_in_Chin...
I sort-of see where you're coming from, but it also ignores a double standard to me. Don't buy search from a company that uses an api from another company that is (or was? unclear) based in a country that invaded another country and completely upended the world order. For some people that's a line that they don't want to cross and I get it.
However if that's the case how can they continue buying Chinese products when China has done the same thing, but worse, and for longer, to their own population? Because it's less convenient to stop? _That_ to me lands squarely in the "take whatever stand you want" category with the addendum of, "and don't worry if it doesn't make sense."
Is it because it's within their own borders and therefore isn't our problem?
And the fact that there are other countries that should also be considered terrorists, doesn't mean we shouldn't boycott this one. It means we should boycott them all. But boycotting a few is still better than nothing.
Honest answers are yes, yes, and yes. It may be unavoidable for the average person to avoid imported goods from China, but we should remain aware of our place in the world and try where we can. If the US does invade Venezuela, I sincerely hope that individuals and business owners try to cut as many ties with complicit US tech companies as possible. Honestly, with this clusterfuck of war crimes going on over "drug boats," I hope they're already starting.
Thank you. Didn't know that and was, until now, considering paying for a Kagi subscription.
> "We do not discriminate based on current geopolitical issues."
That's one way of phrasing it.
Yandex has the best reverse image search by a huge margin.
What's your point? Yandex is a good place to search for things Google has been ordered to not show you. Has been for a decade by now.
Meh. Most people, including myself, couldn't care less, and Yandex image search is very capable.
I remain amazed by the lack of attention given to this.
Regardless of one's position on the 'everything online is Russian propaganda, Russian bots or misinformation - invest in sickles and hammers, comrade / wtf just use basic common sense and the internet is as safe as it ever was' continuum, such universal enthusiasm for a Russian-owned, Russian-controlled search engine should generate a little more counter-argument, at the very least.
Absolutely no mention of Google, Bing, Startpage, DDG, or even Mojeek search engines usually pass online without somebody detailing the problems, flaws, or why they're not as good as the alternatives. Usually, at least 20% of the comments will be overtly critical, with at least 1 person passionately arguing that this search engine is going to destroy life as we know it / funds genocide / is an abomination unto God.
On open forums and spaces where a variety of users and tastes are represented, that minimum level of criticism usually applies to absolutely everything from movies to toothbrushing techniques to kids' TV to low-carb breakfasts. If more than 3 people care enough about something to discuss it, at least 1 of those people will hate it and feel the need to enunciate why.
Except Kagi. Kagi must enjoy the highest praise-criticism ratio of anything I've ever seen on the web, including concepts like sunshine and heaven and the eradication of polio.
Seriously. The only 'real' criticism I ever see of Kagi is like 'I personally don't like it because I don't think a search engine is worth more than $19.99' or 'unfortunately I need x feature', and it's always followed by a reply saying 'Ah, well Kagi is now available for $19.50' or 'you'll be thrilled to know that x feature can be enabled in Kagi by following these steps'.
And the occasional 'I don't use it because it seemed a bit wierd and wasn't worth it' comment languishing on the outskirts of the discussion.
So yeah. I do not expect this comment to stir much discussion, mainly because it's like 24 hours after the main debate and is on a pretty low-impact thread on hacker news from an uninspiring new ish account. But also because Kagi critical comments are written in sand, whatever the discussion or authority or audience.
That should make people more suspicious.
> But also because Kagi critical comments are written in sand, whatever the discussion or authority or audience.
Maybe people just turn up too late and their comments generally aren't seen?
based Vlad tbh
I’ve had much better results with Kagi than with Google in the past few months. I’d trialed them a couple times in the past and been disappointed, but that’s no longer the case.
The AI stuff in google search can be turned off.
My default browser search tool is set to google with ?udm=14 automatically appended.What is UDM? Presumably the U is Urchin but what’s the rest?
Never seen it documented.
Haven't looked back since I signed up.
How does Kagi know what is AI stuff? I don't see how they can 'just turn it off'
By "turn it off" I mostly mean that Kagi have their own AI driven tools available, but a toggle in your user settings disables it completely.
ie it's not forced down your throat, nor mysteriously/accidentally/etc turned back on occasionally
It's driven by community ratings.
https://news.ycombinator.com/item?id=45919067
so it is like humans vs robots started? robots ask humans questions to verify they are not robots. humans mark content as robot-generated to filter it out.
My first instinct is that users abuse it like they do any other report/downvote mechanism. They see something they just don't plain like, they report it as AI slop.
what if there was an open source search engine that contributors kept making better but it was a paid subscription tool?
There is also the fact that automatically generated content predates ChatGPT by a lot. By around 2020 most Google searches already returned lots of SEO-optimized pages made from scrapped content or keyword soups made by rudimentary language models or markov chains.
Well there's also the fact that GPT-3 API was released in June 2020 and its writing capabilities were essentially on par with ChatGPT initial release. It was just a bit harder to use, because it wasn't yet trained to follow instructions, it only worked as a very good "autocomplete" model, so prompting was a bit "different" and you couldn't do stuff like "rewrite this existing article in your own words" at all, but if you just wanted to write some bullshit SEO spam from scratch it was already as good as ChatGPT would be 2 years later.
Also the full release of GPT-2 in late 2019. While GPT-2 wasn't really "good" at writing, it was more than good enough to make SEO spam
I didn't remember that, but it would explain the spam exponential grow back then.
And 10 years ago, Reddit was already experimenting with auto-generated subreddits: https://www.reddit.com/r/SubredditSimulator.
It was popular way before 2020 but Google managed to keep up with SEO tricks for good decade+ before. Guess it got to breaking point.
> Google made the search results worse here
Did you mean:
worse results near me
are worse results worth it
worse results net worth
best worse results
worse results reddit
search: Emacs
Tbh, this sounds like a Google Easter egg.
Because it is
> if I search on Google search for specific terms, I am not interested in crap such as "others also searched for xyz" - that is just ruining the UI with irrelevant information
You assume the aim here is for you to find relevant information, not increase user retention time. (I just love the corporate speak for making people's lives worse in various ways.)
You finding relevant information used to be the aim. Enshittification started when they let go of that aim.
I think this is about trustworthy content, not about a good search engine per se
But it's not necessarily trustworthy content, we had autogenerated listicles and keyword list sites before ChatGPT.
Sure, but I think that the underlying assumption is that, after the public release of ChatGPT, the amount of autogenerated content on the web became significantly bigger. Plus, the auto-generated content was easier to spot before.
Honestly the biggest failing is just SEO spam sites got too good at defeating the algorithm. The amount of bloody listicles or quora nonsense or backlink farming websties that come up in search is crazy.
I feel like google gave up the fight at some point. I think HN had some good articles that indicated that.
Certainly seems that way if you observed the waves of usability Google search underwent in the first 15 years. There was several distinct cycles where the results were great, then garbage, then great again. They would be flooded with SEO spam, then they would tweak and penalize the SEO spam heavily, then SEO would catch up.
The funny thing is that it seems like when they gave up it wasn't because some new advancement in the arms race. It was well before LLMs hit the scene. The SEO spam was still incredibly obvious to a human reader. Really seems like some data-driven approach demonstrated that surrendering on this front led to increased ad revenue.
For most commercial related terms, I suspect if you got rid of all “spanmy” results you would be left with almost nothing. No independent blogger is gonna write about the best credit card with travel points.
I agree with your point, but you picked a poor example. Have you met any credit reward min-maxers?
I had a coworker who kept up a blog about random purchases she’d made, where she would earn some money via affiliate links. I thought it was horrendously boring and weird, and the money made was basically pocket change, but she seemed to enjoy it. You might be surprised, people write about all sorts of things.
People used to do it early internet before affiliate marketing really took it over. Certainly it was more genuine and products were bemoaned for their compromises in one dimension as much as praised for their performance in another. Everything is a glowing review now and comparisons are therefore meaningless.
Sites like Credit Karma / NerdWallet exist. While I think they are rife with affiliate link nonsense and paid promotion masquerading as advice, I'm also pretty sure they have paid researchers and writers generating genuine content. Not sure that quite falls into the bucket of SEO blogspam.
It still counts because they would only ever recommend affiliate partnered products.
This is bullshit the search engines want you to believe. It's trivial to detect sites that "defeat" the algorithm; you simply detect their incentives (ads/affiliate links) instead.
Problem is that no mainstream search engine will do it because they happen to also be in the ad business and wouldn't want to reduce their own revenue stream.
Afaik they did not lost the fight. They stopped trying, because it was good for short term earnings
Yes, this is true. It was revealed in Google emails released during antitrust hearings. Google absolutely made a deliberate decision to enshittify their search results for short term gains.
Though maybe it's a long term gain. I know many normal (i.e. non-IT) people who've noticed the poor search results, yet they continue to use Google search.
I've been using DuckDuckGo for the last... decade or so. And it still seems to return fairly relevant documentation towards the top.
To be fair, that's most of what I use search for these days is "<<Programming Language | Tool | Library | or whatever>> <<keyword | function | package>>" then navigate to the documentation, double check the versions align with what I'm writing software in, read... move on.
Sometimes I also search for "movie showtimes nyc" or for a specific venue or something.
So maybe my use cases are too specific to screw up, who knows. If not, maybe DDG is worth a try.
DuckDuckGo uses Bing search results.
ML and AI killed it between 2011-2016 somewhere. https://en.wikipedia.org/wiki/Dead_Internet_theory
Significant changes were made to Google and YouTube in 2016 and 2017 in response to the US election. The changes provided more editorial and reputation based filtering, over best content matching.
> The problem
That's a separate problem. The search algorithm applied on top of the underlying content is a separate problem from the quality or origin of the underlying content, in aggregate.
Counterpoint: The experience of quickly finding succinct accurate responses to queries has never been better.
Years ago, I would consider a search "failed" if the page with related information wasn't somewhere in the top 10. Now a search is "failed" if the AI answer doesn't give me exactly what I'm looking for directly.
Goodhart's law applies to links, too. Google monetized them and destroyed their value as a signal.
> I am not 100% certain why Google decided to ruin google search.
Ask Prabhakar Raghavan. Bet he knows.
The problem is that before Nov 30, 2022 we also had plenty of human-generated slop bearing down on the web. SEO content specifically.
the main theory is that with bad results you have to search more and get more engaged in ads so more revenue for google. Its enshitification
[dead]