this post was submitted on 28 Aug 2023
63 points (100.0% liked)

Technology

37750 readers
249 users here now

A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.

Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.

Subcommunities on Beehaw:


This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.

founded 2 years ago
MODERATORS
 

IT DIDN'T TAKE long. Just months after OpenAI’s ChatGPT chatbot upended the startup economy, cybercriminals and hackers are claiming to have created their own versions of the text-generating technology. The systems could, theoretically at least, supercharge criminals’ ability to write malware or phishing emails that trick people into handing over their login information.

all 27 comments
sorted by: hot top controversial new old
[–] Adramis@beehaw.org 83 points 1 year ago* (last edited 1 year ago) (2 children)

Oh no, CrImInAlS. We'd better make sure only big corps can use this tech and legislate against individual use. /s

[–] theangriestbird@beehaw.org 26 points 1 year ago (1 children)

Right? The nerve it takes to create an AI model from copyrighted work, and then turn around and call your copycats "criminals". Y'all, you started a criminal enterprise.

[–] agressivelyPassive@feddit.de 14 points 1 year ago (2 children)

That's not the point, and you should actually read the article.

The "criminals" are using AI tools to commit what experts call "crimes". The creation of the tools is not the crime, but their use for criminal purposes is.

Self-righteous, uninformed rage doesn't help anyone.

[–] Anticorp@lemmy.ml 7 points 1 year ago (1 children)

There seems to be an excessive amount of that on this platform the last few weeks.

[–] CanadaPlus@lemmy.sdf.org 3 points 1 year ago

Clearly, this is a very viable Reddit successor.

[–] theangriestbird@beehaw.org 3 points 1 year ago (1 children)

The “criminals” are using AI tools to commit what experts call “crimes”. The creation of the tools is not the crime, but their use for criminal purposes is.

i phrased my statement a little weirdly, but i understood this point perfectly when i made my comment. they created copycat LLMs that don't have the same "safeguards" in place, so these new LLMs can be used to write malware and produce other illegal results. My point was: it seems funny to call this criminal and call ChatGPT "legitimate" just because ChatGPT can't write malware.

[–] agressivelyPassive@feddit.de 1 points 1 year ago

Well, yeah, because that's kind of the point?

ICBMs and Falcon9s are both rockets, but one kind is much more concerning.

[–] Anticorp@lemmy.ml 7 points 1 year ago

I was just thinking along the same lines "welp, there goes our open access to powerful AI functionality. It was fun for the few short months we had it".

[–] lily33@lemm.ee 45 points 1 year ago* (last edited 1 year ago)

Oh, no, bad guys can use [insert new technology here], too!

More seriously, yes. And it can also be used to detect scams and spam.

[–] frog@beehaw.org 35 points 1 year ago (1 children)

I find it faintly amusing that, at least for me, the post directly below this one is "making large language models work for you". Clearly advice that the criminals have taken to heart.

[–] xtremeownage@lemmyonline.com 15 points 1 year ago (3 children)

I don't see this as a bad thing.

Malware that breaks due to bugs any normal sane developer would have detected.

My experience with chatGPT, it's a great TOOL. But, the code it generates, is very frequently incorrect. But, the problem is, the code it generates LOOKS good. And, will actually likely work, mostly.

[–] drwho@beehaw.org 17 points 1 year ago

In other words, don't interrupt your enemy when they're making a mistake.

[–] mobyduck648@beehaw.org 3 points 1 year ago (1 children)

That’s fundamentally why you can’t replace a software engineer with ChatGPT, only a software engineer has the skillset to verify the code isn’t shit even if it superficially works.

[–] xtremeownage@lemmyonline.com 1 points 1 year ago

Yup.

I find it can be quite a useful tool. But, I also know when to spot its mistakes. I had it generate and cleanup some code the other day, and found 4 or 5 pretty big issues with it, which would have been hardly detectable by a more novice developer.

After, telling it about its own issues, it was able to identify and correct them.

Its, kind of like mentoring a new developer.