this post was submitted on 12 Sep 2024
1 points (100.0% liked)

Technology

59566 readers
3235 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

For OpenAI, o1 represents a step toward its broader goal of human-like artificial intelligence. More practically, it does a better job at writing code and solving multistep problems than previous models. But it’s also more expensive and slower to use than GPT-4o. OpenAI is calling this release of o1 a “preview” to emphasize how nascent it is.

The training behind o1 is fundamentally different from its predecessors, OpenAI’s research lead, Jerry Tworek, tells me, though the company is being vague about the exact details. He says o1 “has been trained using a completely new optimization algorithm and a new training dataset specifically tailored for it.”

OpenAI taught previous GPT models to mimic patterns from its training data. With o1, it trained the model to solve problems on its own using a technique known as reinforcement learning, which teaches the system through rewards and penalties. It then uses a “chain of thought” to process queries, similarly to how humans process problems by going through them step-by-step.

At the same time, o1 is not as capable as GPT-4o in a lot of areas. It doesn’t do as well on factual knowledge about the world. It also doesn’t have the ability to browse the web or process files and images. Still, the company believes it represents a brand-new class of capabilities. It was named o1 to indicate “resetting the counter back to 1.”

I think this is the most important part (emphasis mine):

As a result of this new training methodology, OpenAI says the model should be more accurate. “We have noticed that this model hallucinates less,” Tworek says. But the problem still persists. “We can’t say we solved hallucinations.”

(page 2) 50 comments
sorted by: hot top controversial new old
[–] Binette@lemmy.ml 0 points 2 months ago

Reinforcement learning my beloved ❤️

[–] sinceasdf@lemmy.world 0 points 2 months ago (1 children)

Lol Lemmy has the funniest ai haters they drown out any real criticism with stupid strawman nonsense

load more comments (1 replies)
[–] khepri@lemmy.world 0 points 2 months ago (2 children)

So they slapped some reinforcement learning on top of their LLM and are claiming that gives it “reasoning capabilities”? Or am I missing something?

[–] Evotech@lemmy.world 0 points 2 months ago

It's like 3 lms on top of eachother in a trenchcoat, and appau a calculator so it gets math right

load more comments (1 replies)
[–] Etterra@lemmy.world 0 points 2 months ago (1 children)

That's not what reasoning is. Training is understanding what they're talking about and being able to draw logical conclusions based on what they've learned. It's being able to say, I didn't know but wait a second and I'll look it up," and then summing that info up in original language.

All Open AI did was make it less stupid and slap a new coat of paint on it, hoping nobody asks too many questions.

[–] ours@lemmy.world 0 points 2 months ago

And this is something data scientists have already been doing with existing LLMs.

[–] drspod@lemmy.ml 0 points 2 months ago (1 children)

Can't wait to read about it telling someone to put glue on pizza.

[–] Imgonnatrythis@sh.itjust.works 0 points 2 months ago (1 children)

This is smarter. Will tell you how to pump a Calzone full of glue.

[–] AdamEatsAss@lemmy.world 0 points 2 months ago

And provide the logical reasoning behind it!

[–] oakey66@lemmy.world 0 points 2 months ago (29 children)

It's a better prediction model. There's no reasoning because it's not understanding anything you're typing. We're not closer to general ai.

Being better at prediction requires reasoning

[–] Drunemeton@lemmy.world 0 points 2 months ago (4 children)

I wish more people would realize this! We’re years away from a truly reasoning computer.

Right now it’s all mimicry. Mimicry that hallucinates no less…

load more comments (4 replies)
load more comments (27 replies)
[–] Danitos@reddthat.com 0 points 2 months ago

Terrence Tao shared his thoughs on Mastodon: https://mathstodon.xyz/@tao/113132502735585408

[–] LANIK2000@lemmy.world 0 points 2 months ago (2 children)

Dang, OpenAI just pulled an Apple. Do something other people have already done with the same results (but importantly before they made a big fuss about it), claim it's their innovation, give it a bloated name so people imagine it's more than it is and produce a graph comparing themselves to themselves, hoping nobody will look at the competition.

On a side note they also pulled an Elon. Where's my realtime AI companion that can comment on video in realtime and sing to me??? Ya had it "working" "live" a couple months ago, WHERE IS IT?!?

[–] semperverus@lemmy.world 0 points 2 months ago* (last edited 2 months ago)

Meanwhile a bald turtle and his AI anime daughter on twitch can do exactly this, and he's building her at home on nvidia GPUs.

(Vedal987 and Neuro-sama, if you're curious)

[–] riodoro1@lemmy.world 0 points 2 months ago (1 children)

Pulled an Apple?

I know you hate apple because android is way better but people loved their ipods, iphones, airpods and apple watches. Sure those things were made before but Apple did make them better. So I don’t know what your point is.

[–] LANIK2000@lemmy.world 0 points 2 months ago* (last edited 2 months ago)

Assuming I'm an android fan for pointing out that Apple does shady PR. I literally mention that Apple devices have their selling point. And it isn't UNMATCHED PERFORMANCE or CUTTING EDGE TECHNOLOGY as their adds seems to suggest. It's a polished experience and beautiful presentation; that is unmatched. Unlike the hot mess that is android. Android also has its selling points, but this reply is already getting long. Just wanted to point out your pettiness.

[–] ulkesh@lemmy.world 0 points 2 months ago (2 children)

I just love how people seem to want to avoid using the word lie.

It’s either misinformation, or alternative facts, or hallucinations.

Granted, a lie does tend to have intent behind it, so with ChatGPT, it’s probably better to say falsehood, instead. But either way, it’s not fact, it’s not truth, and people, especially schools, should stop using it as a credible source.

[–] JustTesting@lemmy.hogru.ch 0 points 2 months ago

There was a recent paper that argues 'bullshitting' is the most apt analogy. I.e. telling something to satisfy the other person without caring about the truth content of what you say

load more comments (1 replies)
[–] Lucidlethargy@sh.itjust.works 0 points 2 months ago (1 children)

I think I've used it if this is the latest available, and it's terrible. It keeps feeding me wrong information, and when you correct it, it says you're right... But if you ask it again, it again feeds you the wrong information.

[–] leftzero@lemmynsfw.com 0 points 2 months ago

if you ask it again, it again feeds you the wrong information

Well, it's a LLM, they can't learn anything without rebuilding the whole model from scratch, which I wouldn't exactly call learning anyway... all they “know” is what word is most likely to follow a certain sequence of words according to their model.
Any other facts or information are completely inconsequential for their operation and results.

load more comments
view more: ‹ prev next ›