Back

The shrinking landscape of linguistic diversity in the age of LLMs

44 points4 daysnature.com
unsignedint55 minutes ago

But then, is that necessarily a bad thing?

In most cases where language is being used as a vehicle for exchanging ideas, isn't some degree of uniformity actually desirable for clarity? I personally wouldn't want instruction manuals to be full of colorful or highly individualized language, for instance.

That's not to say linguistic diversity is meaningless, but I would argue that this particular concern is fairly specialized and matters much more in literature and other creative forms of writing.

eloisius32 minutes ago

This makes is sound like everything except a narrow slice of “creative forms” should be subject to a giant efficiency optimization. I’ve never noticed instruction manuals to be hard to understand because of colorful language, so I don’t believe we need to optimize further in that regard. Why stop with language? Shouldn’t every personality outside of “creative forms” be more standardized? Sure I want to laugh at comedians, but wouldn’t it be more efficient for us to work together if everyone had a totally fungible personality?

Engineers often reduce human interaction and creativity down to computer analogs like “exchanging data,” treat work and business as life’s raison d’etre and then we wonder why every car on the road is monochrome and we’re on the umpteenth Gardian of the Avangers film.

vector_spaces20 minutes ago

I completely agree with your critique here but I will say that I have had difficulty understanding pure math texts because of 'colorful' language -- e.g. "chattier" treatments of mathematical analysis. But I will also say that I'm glad such treatments of the material exist, partly because I know that what appeals to me doesn't appeal to others and these might be a valued resource for them, and because often pushing through and understanding texts that were difficult at first helps us to see the material from a different perspective. I think this optimization perspective squashes this possibility a bit when taken too far, as it usually is

dyauspitr5 minutes ago

There’s no universal answer. Like most things it’s highly subjective and some people will want the standardization line to be in a particular place than someone else. I for instance, love the standardization of programming and science research for the most part into one language but at the same time, I also feel terrible about languages that are hundreds of thousands of years old disappearing forever.

mlsu10 minutes ago

Think of how much money we could make if we weren't wasting so much time being creative.

mr_toad40 minutes ago

Linguistic diversity has been used as a casus belli, at least indirectly. It’s something that populations will take up arms for, so it’s probably worth tiptoeing around.

xpct30 minutes ago

PG's 'learning a word' ~= 'learning an idea' comes to mind

Brian_K_White32 minutes ago

"is that necessarily a bad thing?"

Yes.

The value of the diversity is not just aesthetic.

Human laguage is rich and expressive, matching human thought. The diversity is part of the expressiveness. Saying something in some poetic, or merely different way, is not just an inefficient or ambiguous/confusing way of saying the same thing, it's saying something else, and that something else cannot be expressed any other way.

A crayons-only, thumbs-only, Apple one-button-only, 1000 word vocabulary world is not efficient, it's poor.

tehlike47 minutes ago

Eh, not hard to notice some people indeed started to write like LLMs too. Not completely but hints are there.

bitxbitxbitcoin4 days ago

I feel the conformity creeping in just from reading more LLM generated or edited text. The only way to counter I can think of is to read as much olde literature as possible, and/or to fully embrace whatever slang the young jits are yeeting into existence nowadays.

robviren1 hour ago

Embrace the esoteric! Grammar and sentence structure are but mear suggestions when everything I author can be claimed free form written poetry. The counter culture is humanity, we can be the embodiment.

I do agree though. Finding actual strung together words by humans is not easy these days.

mr_toad24 minutes ago

> Grammar and sentence structure are but mear suggestions

Learning French has been eye opening, in that many grammatical structures that are optional in English are compulsory in French. Abbreviations for example: “it is” or “it’s” are both valid in English, but in French you’re not supposed to say “ce est”, you have to say “c’est”.

devin1 hour ago

Here are some. I typed them just for you.

MithrilTuxedo1 hour ago

Dictionaries have been trying to retard linguistic progress since the first edition of one tried to nail down every meaning of a term.

Anon8449 minutes ago

Interestingly, you can trace “American” English becoming its own thing [1] to the publication of the first Webster dictionary that made a conscious effort to simplify spelling. American and British dialects have been diverging ever since (although British has been becoming more American since the turn of the millennium).

[1] https://journals.plos.org/plosone/article/figures?id=10.1371...

catlifeonmars47 minutes ago

I disagree. Dictionaries are mostly descriptive as opposed to prescriptive. They wouldn’t be particularly useful if they weren’t.

That being said, I have seen people weaponize dictionary definitions if that’s what you were referring to.

vonunov3 days ago
Tanoc3 days ago

One thing that is distasteful but effective is excessive use of profanity, broken aphorisms, and shattered English. LLMs hate cursing because of their guardrails, and since they don't actually understand language they can never truly piece together a broken aphorism such as the classic "People die if they are killed" because they're too literal. As for shattered English (think of the caveman speak from The Office with the quote "Why waste time say many word when few word do trick?") because it is intentionally mangled, has no rules, and the understanding is extremely context specific it gets your brain to pay more attention, and if you are the speaker brain do work more clever make thing say funny.

It's not lost on me that the lowbrow humour of some too strict translation and a throwaway sitcom joke people thought was funny back in 2007 could be a way to stave off linguistic homogeneity.

For the use of profanity the data in the paper seems to indicate that swearing is retained in the LLM rewritten examples. Profanity however is rather subjective could be anything from saying the more mundane "oh my god" and "damn" to the extreme "shit eating fucklungerer" or use of slurs, but it's unstated in the paper as to the severity of the profanity. It's the severity of it that's important though, as LLMs restrain themselves from using something like "shit eating fucklungerer" unless explicitly told to.

ChickeNES12 minutes ago

> LLMs hate cursing because of their guardrails,

No they don't, ChatGPT swears all the time to me, plenty of fucks, shits, etc, even in push notifications from the app (which surprised me at first, and is why I remember it).

a2ff6eeb045 minutes ago

This is only natural; a great deal of the writing analyzed is by one of three authors at this point, in spite of the by-line. One of them is named Claude.

Look at the posts on this site. A massive portion of them are very obviously written by AI.

As AI gets better, I expect fewer people will do the toil of writing.

robocat12 minutes ago

Just another wave of influence: books, radio, TV, internet, now AI.

Down here in the colony of New Zealand, the influence of the colony of North America is very noticeable. Music is the most directly attributable, but different media affects different demographics.