this post was submitted on 26 Jun 2023
56 points (100.0% liked)
Technology
37739 readers
500 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I guess the important thing to understand about spurious output (what gets called "hallucinations") is that it's neither a bug nor a feature, it's just the nature of the program. Deep learning language models are just probabilities of co-occurrence of words; there's no meaning in that. Deep learning can't be said to generate "true" or "false" information, or rather, it can't be meaningfully said to generate information at all.
So then people say that deep learning is helping out in this or that industry. I can tell you that it's pretty useless in my industry, though people are trying. Knowing a lot about the algorithms behind deep learning, and also knowing how fucking gullible people are, I assume that—if someone tells me deep learning has ended up being useful in some field, they're either buying the hype or witnessing an odd series of coincidences.
I think it can be useful. I have used it myself, even before chatgpt was there and it was just gpt 3. For example I take a picture, OCR it and then look for mistakes with gpt because it's better than a spell check. I've used it to write code in a language I wasn't familiar with and having seen the names of the commands needed I could fix it to do what I wanted. I've also used it for some inspiration, which I could also have done with an online search. The concept just blew up and people were overstating what it can do, but I think now a lot of people know the limitations.