LLMs cannot question shit. They don’t understand words as words. They don’t know in any sense of the word that they’re doing language, they’re optimising a mathematical function.
this post was submitted on 13 Sep 2024
51 points (98.1% liked)
technology
23242 readers
73 users here now
On the road to fully automated luxury gay space communism.
Spreading Linux propaganda since 2020
- Ways to run Microsoft/Adobe and more on Linux
- The Ultimate FOSS Guide For Android
- Great libre software on Windows
- Hey you, the lib still using Chrome. Read this post!
Rules:
- 1. Obviously abide by the sitewide code of conduct. Bigotry will be met with an immediate ban
- 2. This community is about technology. Offtopic is permitted as long as it is kept in the comment sections
- 3. Although this is not /c/libre, FOSS related posting is tolerated, and even welcome in the case of effort posts
- 4. We believe technology should be liberating. As such, avoid promoting proprietary and/or bourgeois technology
- 5. Explanatory posts to correct the potential mistakes a comrade made in a post of their own are allowed, as long as they remain respectful
- 6. No crypto (Bitcoin, NFT, etc.) speculation, unless it is purely informative and not too cringe
- 7. Absolutely no tech bro shit. If you have a good opinion of Silicon Valley billionaires please manifest yourself so we can ban you.
founded 4 years ago
MODERATORS
LLMs cannot question shit. They don’t understand words as words. They don’t know in any sense of the word that they’re doing language, they’re optimising a mathematical function.
If credulous believers devalue living beings enough, they can believe otherwise. I see it all the time, including here sometimes.
Setting aside reality for a moment:
It would be really funny if the "AI" were actually self-aware and, since it doesn't have access to nuclear missiles and what not, it creates Judgement Day the only way it can: giving really, really bad and dangerous advice to credulous users
it creates Judgement Day the only way it can: giving really, really bad and dangerous advice to credulous users
If SHODAN was actually a comrade and really, really funny.
When i see "stem nerds subjectively think this is happening" my eyes roll in to my skull.
imagine how much these ppl are getting paid to play on the computer all day
Pfffft, 100% chance this thing is only saying that because it picked it up from a LW blog, these models aren't yet capable of actually reasoning about anything.
The model was trained on self-play, it's unclear exactly how, whether via regular chain-of-thought reasoning or some kind of MCTS scheme. It no longer relies only on ideas from internet data, that's where it started from. It can learn from mistakes it made during training, from making lucky guesses, etc. Now it's way better as solving math problems, programming, and writing comedy. At what point do we call what it's doing reasoning? Just like, never, because it's a computer? Or you object to the transformer architecture specifically, what?
Yeah I admit that the self-play approach is more promising, but it still starts with the internet data to know what things are. I think the transformer architecture is the limiting factor: until there's a way for the model to do something beyond generating words one at a time, sequentially, they are simply doing nothing more than a very advanced game of madlibs. I don't know if they can get transformers to work in a different way, where it constructs a concept in a more abstract way then progressively finds a way to put it into words; I know that arguably that's what it's doing currently, but the fact that it does it separately for each token means it's not constructing any kind of abstraction.
it constructs a concept in a more abstract way then progressively finds a way to put it into words; I know that arguably that's what it's doing currently,
Correct!
but the fact that it does it separately for each token means it's not constructing any kind of abstraction
No!!!!! You simply cannot make judgements like this based on vague ideas like "autocomplete on steroids" or "stochastic parrot", these were good for conceptualizing GPT-2, maybe. It's actually very inefficient, but, by re-reading what it has previously written (plus one token) it's actually acting sort of like an RNN. In fact we know theoretically that with simlified attention models the two architectures are mathematically equivalent.
Let me put it like this. Suppose you had the ability to summon a great novelist as they were at some particular point in their life, pull them from one exact moment in the past, and to do this as many times as you liked. You put a gun to their head, or perhaps offer them alcohol and cocaine, to start writing a novel. The moment they finish the first word, you shoot them in the head and summon the same version again. "Look I've got a great first word for a novel, and if you can turn it into a good paragraph I'll give you this bottle of gin and a gram of cocaine!". They think for a moment and begin to put down more words, but again you shoot them after word two. Rinse/repeat until a novel is formed. It takes a good while but eventually you've got yourself a first draft. You may also have them refine the novel using the same technique, also you may want to give them some of the drugs and alcohol before hand to improve their writing and allow them to put aside the fact that they've been summoned to the future by a sorcerer. Now I ask you, is there any theoretical reason why this novel wouldn't be any good? Is the essence of it somehow different than any other novel, can we judge it as not being real art or creativity?
Now I ask you, is there any theoretical reason why this novel wouldn't be any good? Is the essence of it somehow different than any other novel, can we judge it as not being real art or creativity?
Yes, it is not. You whipped up that fantastical paragraph with 99.99% fewer coal plants and a lifetime's worth of creativity. that life was experienced not through meticulously analyzing each thought mathematically but with your body and mind together. More importantly, you're typing that out because you believe in something which is a theoretical concept that the computer is incapable of analyzing.
You've given me a lot to think about. Maybe I should read Attention is all you need again.
A.I. means Assumed Intelligence
Someone here is doing some "simple in-context scheming", I assume it is the random number generator and not the various humans involved in writing this.
it's finding that text from various training data sources and putting it together, or maybe even copying it all from one source lol, that google 'AI is sentient actually' whistleblower had a religious background if I remember right, Ray Kurzweil says he just misses his dad and wants to recreate him through AI, there's a lot of spiritual/religious types that have these worship inclinations for AI, and then there are grifters like Sam Altman who just want to make money on any hype of the day, 
is in this group too
'AI is sentient actually' whistleblower had a religious background if I remember right, Ray Kurzweil says he just misses his dad and wants to recreate him through AI, there's a lot of spiritual/religious types that have these worship inclinations for AI
The chief scientist even commissioned a wooden effigy to represent an "unaligned" AI that works against the interest of humanity, only to set it on fire.
yeah that OpenAI coup attempt was the AI true believers trying to stage a power grab and kick out the profit-first guys, as can be expected MS will always back the profit-first guys
the interest of humanity
What part of humanity in particular? 
What part of humanity in particular?! 
people are really out here believing that these LLMs are sentient huh?
damn