this post was submitted on 05 Feb 2025
151 points (81.1% liked)

Technology

61632 readers
4174 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots


founded 2 years ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] HoofHearted@lemmy.world 0 points 9 hours ago (3 children)

The terrifying thing is everyone criticising the LLM as being poor, however it excelled at the task.

The question asked was how many R in strawbery and it answered. 2.

It also detected the typo and offered the correct spelling.

What’s the issue I’m missing?

[–] Tywele@lemmy.dbzer0.com 19 points 9 hours ago (1 children)

The issue that you are missing is that the AI answered that there is 1 'r' in 'strawbery' even though there are 2 'r's in the misspelled word. And the AI corrected the user with the correct spelling of the word 'strawberry' only to tell the user that there are 2 'r's in that word even though there are 3.

[–] TomAwsm@lemmy.world 0 points 8 hours ago (1 children)

Sure, but for what purpose would you ever ask about the total number of a specific letter in a word? This isn't the gotcha that so many think it is. The LLM answers like it does because it makes perfect sense for someone to ask if a word is spelled with a single or double "r".

[–] spankmonkey@lemmy.world -1 points 8 hours ago (1 children)

It makes perfect sense if you do mental acrobatics to explain why a wrong answer is actually correct.

[–] TomAwsm@lemmy.world 1 points 7 hours ago

Not mental acrobatics, just common sense.

[–] TeamAssimilation@infosec.pub 5 points 9 hours ago

Uh oh, you’ve blown your cover, robot sir.

[–] Fubarberry@sopuli.xyz 3 points 8 hours ago (1 children)

There's also a "r" in the first half of the word, "straw", so it was completely skipping over that r and just focusing on the r's in the word "berry"

[–] catloaf@lemm.ee 1 points 8 hours ago

It wasn't focusing on anything. It was generating text per its training data. There's no logical thought process whatsoever.