this post was submitted on 12 Sep 2024
1 points (100.0% liked)
Technology
58513 readers
4279 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I'd recommend everyone saying "it can't understand anything and can't think" to look at this example:
https://x.com/flowersslop/status/1834349905692824017
Try to solve it after seeing only the first image before you open the second and see o1's response.
Let me know if you got it before seeing the actual answer.
This example doesn't prove what you think it does. It shows pattern detection - something computers are inherently very well suited for - but it doesn't demonstrate "reasoning" in any meaningful way.
You should really look at the full CoT traces on the demos.
I think you think you know more than you actually know.
Got a link to that?
Yep:
https://openai.com/index/learning-to-reason-with-llms/
First interactive section. Make sure to click "show chain of thought."
The cipher one is particularly interesting, as it's intentionally difficult for the model.
The tokenizer is famously bad at two letter counts, which is why previous models can't count the number of rs in strawberry.
So the cipher depends on two letter pairs, and you can see how it screws up the tokenization around the xx at the end of the last word, and gradually corrects course.
Will help clarify how it's going about solving something like the example I posted earlier behind the scenes.
You mean like this chain of thought?
I think if you can actually define reasoning, your comments (and those like yours) would be much more convincing. I'm just calling yours out because I've seen you up and down in this thread repeating it, but it's a general observed of the vocal critics of the technology overall. Neither intelligence nor reasons (likewise understanding and knowing, for that matter) are easily defined in a way that is more useful than invoking spirits and ghosts. In this case, detecting patterns certainly seems a critical component of what we would consider to be reasoning. I don't think it's sufficient, buy it is absolutely necessary.