this post was submitted on 25 Aug 2024
1 points (100.0% liked)

Technology

60560 readers
3414 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 2 years ago
MODERATORS
top 50 comments
sorted by: hot top controversial new old
[–] CarbonatedPastaSauce@lemmy.world 0 points 4 months ago (6 children)

The only people who would say this are people that don’t know programming.

LLMs are not going to replace software devs.

[–] tias@discuss.tchncs.de 0 points 4 months ago (2 children)

AI as a general concept probably will at some point. But LLMs have all but reached the end of the line and they're not nearly smart enough.

[–] homesweethomeMrL@lemmy.world 0 points 4 months ago

"at some point" being like 400 years in the future? Sure.

Ok that's probably a little bit of an exaggeration. 250 years.

[–] li10@feddit.uk 0 points 4 months ago (7 children)

LLMs have already reached the end of the line 🤔

I don’t believe that. At least from an implementation perspective we’re extremely early on, and I don’t see why the tech itself can’t be improved either.

Maybe it’s current iteration has hit a wall, but I don’t think anyone can really say what the future holds for it.

[–] mashbooq@infosec.pub 0 points 4 months ago

I'm not trained in formal computer science, so I'm unable to evaluate the quality of this paper's argument, but there's a preprint out that claims to prove that current computing architectures will never be able to advance to AGI, and that rather than accelerating, improvements are only going to slow down due to the exponential increase in resources necessary for any incremental advancements (because it's an NP-hard problem). That doesn't prove LLMs are end of the line, but it does suggest that additional improvements are likely to be marginal.

Reclaiming AI as a theoretical tool for cognitive science

load more comments (6 replies)
[–] Blue_Morpho@lemmy.world 0 points 4 months ago* (last edited 4 months ago) (6 children)

I can see the statement in the same way word processing displaced secretaries.

There used to be two tiers in business. Those who wrote ideas/solutions and those who typed out those ideas into documents to be photocopied and faxed. Now the people who work on problems type their own words and email/slack/teams the information.

In the same way there are programmers who design and solve the problems, and then the coders who take those outlines and make it actually compile.

LLM will disrupt the programmers leaving the problem solvers.

There are still secretaries today. But there aren't vast secretary pools in every business like 50 years ago.

[–] felbane@lemmy.world 0 points 4 months ago (1 children)

The problem with this take is the assertion that LLMs are going to take the place of secretaries in your analogy. The reality is that replacing junior devs with LLMs is like replacing secretaries with a network of typewriter monkeys who throw sheets of paper at a drunk MBA who decides what gets faxed.

load more comments (1 replies)
[–] VubDapple@lemmy.world 0 points 4 months ago
[–] homesweethomeMrL@lemmy.world 0 points 4 months ago

I thought by this point everyone would know how computers work.

That, uh, did not happen.

[–] IsThisAnAI@lemmy.world 0 points 4 months ago (4 children)

It'll have to improve a magnitude for that effect. Right now it's basically an improved stack overflow.

load more comments (4 replies)
[–] Badabinski@kbin.earth 0 points 4 months ago (2 children)

I wrote a comment about this several months ago on my old kbin.social account. That site is gone and I can't seem to get a link to it, so I'm just going to repost it here since I feel it's relevant. My kbin client doesn't let me copy text posts directly, so I've had to use the Select feature of the android app switcher. Unfortunately, the comment didn't emerge unscathed, and I lack the mental energy to fix it due to covid brain fog (EDIT: it appears that many uses of I were not preserved). The context of the old post was about layoffs, and it can be found here: https://kbin.earth/m/asklemmy@lemmy.ml/t/12147

I want to offer my perspective on the Al thing from the point of view of a senior individual contributor at a larger company. Management loves the idea, but there will be a lot of developers fixing auto-generated code full of bad practices and mysterious bugs at any company that tries to lean on it instead of good devs. A large language model has no concept of good or bad, and it has no logic. happily generate string- templated SQL queries that are ripe for SQL injection. I've had to fix this myself. Things get even worse when you have to deal with a shit language like Bash that is absolutely full of God awful footguns. Sometimes you have to use that wretched piece of trash language, and the scripts generated are horrific. Remember that time when Steam on Linux was effectively running rm -rf /* on people's systems? I've had to fix that same type of issue multiple times at my workplace.

I think LLMs will genuinely transform parts of the software industry, but I absolutely do not think they're going to stand in for competent developers in the near future. Maybe they can help junior developers who don't have a good grasp on syntax and patterns and such. I've personally felt no need to use them, since spend about 95% of my time on architecture, testing, and documentation.

Now, do the higher-ups think the way that do? Absolutely not. I've had senior management ask me about how I'm using Al tooling, and they always seem so disappointed when I explain why I personally don't feel the need for it and what feel its weaknesses are. Bossman sees it as a way to magically multiply IC efficiency for nothing, so absolutely agree that it's likely playing a part in at least some of these layoffs.

Basically, I think LLMs can be helpful for some folks, but my experience is that the use of LLMs by junior developers absolutely increases the workload of senior developers. Senior developers using LLMs can experience a productivity bump, but only if they're very critical of the output generated by the model. I am personally much faster just relying on traditional IDE auto complete, since I don't have to change from "I'm writing code" mode to "I'm reviewing code mode."

[–] mashbooq@infosec.pub 0 points 4 months ago (1 children)

The one colleague using AI at my company produced (CUDA) code with lots of memory leaks that required two expert developers to fix. LLMs produce code based on vibes instead of following language syntax and proper coding practices. Maybe that would be ok in a more forgiving high level language, but I don't trust them at all for low level languages.

load more comments (1 replies)
[–] APassenger@lemmy.world 0 points 4 months ago (1 children)

Will there even be a path for junior level developers?

load more comments (1 replies)
[–] michaelmrose@lemmy.world 0 points 4 months ago

There is no reason to believe that LLM will disrupt anyone any time soon. As it stands now the level of workmanship is absolutely terrible and there are more things to be done than anyone has enough labor to do. Making it so skilled professionals can do more literally just makes it so more companies can produce quality of work that is not complete garbage.

Juniors produce progressively more directly usable work with reason and autonomy and are the only way you develop seniors. As it stands LLM do nothing with autonomy and do much of the work they do wrong. Even with improvements they will in near term actually be a coworker. They remain something you a skilled person actually use like a wrench. In the hands of someone who knows nothing they are worth nothing. Thinking this will replace a segment of workers of any stripe is just wrong.

[–] lemmyuser100002@lemmy.world 0 points 4 months ago (1 children)

Wrong, this is also exactly what people selling LLMs to people who can't code would say.

[–] APassenger@lemmy.world 0 points 4 months ago

It's this. When boards and non-tech savvy managers start making decisions based on a slick slide deck and a few visuals, enough will bite that people will be laid off. It's already happening.

There may be a reckoning after, but wall street likes it when you cut too deep and then bounce back to the "right" (lower) headcount. Even if you've broken the company and they just don't see the glide path.

It's gonna happen. I hope it's rare. I'd argue it's already happening, but I doubt enough people see it underpinning recent lay offs (yet).

[–] Zexks@lemmy.world 0 points 4 months ago

That’s not what was said. He specifically said coding.

[–] assembly@lemmy.world 0 points 4 months ago

The one thing that LLMs have done for me is to make summarizing and correlating data in documents really easy. Take 20 docs of notes about a project and have it summarize where they are at so I can get up to speed quickly. Works surprisingly well. I haven’t had luck with code requests.

[–] Angry_Autist@lemmy.world 0 points 4 months ago (4 children)

I don't know if you noticed but most of the people making decisions in the industry aren't programmers, they're MBAs.

load more comments (4 replies)
[–] Nighed@sffa.community 0 points 4 months ago (1 children)

I'm going to call BS on that unless they are hiding some new models with huge context windows...

For anything that's not boilerplate, you have to type more as a prompt to the AI than just writing it yourself.

Also, if you have a behaviour/variable that is common to something common, it will stubbornly refuse to do what you want.

[–] mozz@mbin.grits.dev 0 points 4 months ago (1 children)

Have you ever attempted to fill up one of those monster context windows up with useful context and then let the model try to do some useful task with all the information in it?

I have. Sometimes it works, but often it’s not pretty. Context window size is the new MHz, in terms of misleading performance measurements.

[–] floofloof@lemmy.ca 0 points 4 months ago

I find there comes a point where, even with a lot of context, the AI just hasn't been trained to solve the problem. At that point it will cycle you round and round the same few wrong answers until you give up and work it out yourself.

[–] suburban_hillbilly@lemmy.ml 0 points 4 months ago

Guys selling something claim it will make you taller and thinner, your dick bigger, your mother in law stop calling, and work as advertised.

[–] DirigibleProtein@aussie.zone 0 points 4 months ago

It will be interesting to find out if these words will come back and haunt them.

  • “I think there is a world market for maybe five computers”.
  • “640K ought to be enough for anybody.”
[–] tal@lemmy.today 0 points 4 months ago* (last edited 4 months ago)

That'd be an exciting world, since it'd massively increase access to software.

I am also very dubious about that claim.

In the long run, I do think that AI can legitimately handle a great deal of what humans do today. It's something to think about, plan for, sure.

I do not think that anything we have today is remotely near being on the brink of the kind of technical threshold required to do that, and I think that even in a world where that was true, that it'd probably take more than 2 years to transition most of the industry.

I am enthusiastic about AI's potential. I think that there is also -- partly because we have a fair number of unknowns unknowns, and partly because people have a strong incentive to oversell the particular AI thing that they personally are involved with to investors and the like -- a tendency to be overly-optimistic about the near-term potential.

I have another comment a while back talking about why I'm skeptical that the process of translating human-language requirements to machine-language instructions is going to be as amenable as translating human-language to human-consumable output. The gist, though, is that:

  • Humans rely on stuff that "looks to us like" what's going on in the real world to cue our brain to construct something. That's something where the kind of synthesis that people are doing with latent diffusion software works well. An image that's about 80% "accurate" works well enough for us; the lighting being a little odd or maybe an extra toe or something is something that we can miss. Ditto for natural-language stuff. But machine language doesn't work like that. A CPU requires a very specific set of instructions. If 1% is "off", a software package isn't going to work at all.

  • The process of programming involves incorporating knowledge about the real world with a set of requirements, because those requirements are in-and-of-themselves usually incomplete. I don't think that there's a great way to fill in those holes without having that deep knowledge of the world. This "deep knowledge and understanding of the world" is the hard stuff to do for AI. If we could do that, that's the kind of stuff that would let us create a general artificial intelligence that could do what a human does in general. Stable Diffusion's "understanding" of the world is limited to statistical properties of a set of 2D images; for that application, I think that we can create a very limited AI that can still produce useful output in a number of areas, which is why, in 2024, without producing an AI capable of performing generalized human tasks, we can still get some useful output from the thing. I don't think that there's likely a similar shortcut for much by way of programming. And hell, even for graphic arts, there's a lot of things that this approach just doesn't work for. I gave an example earlier in a discussion where I said "try and produce a page out of a comic book using stuff like Stable Diffusion". It's not really practical today; Stable Diffusion isn't building up a 3D mental model of the world, designing an entity that stably persists from image to image, and then rendering that. It doesn't know how it's reasonable for objects and the like to interact. I think that to reach that point, you're going to have to have a much-more-sophisticated understanding of the world, something that looks a lot more like what a human's looks like.

    The kind of stuff that we have today may be a component of such an AI system. But I don't think that the answer here is going to be "take existing latent diffusion software and throw a lot of hardware at it". I think that there's going to have to be some significant technical breakthroughs that have not happened yet, and that we're probably going to spend some time heading down dead-end approaches before we get to that. There's probably going to be a lot of hard R&D before we get there, and that's going to take time.

[–] spyd3r@sh.itjust.works 0 points 4 months ago (1 children)

I guess the programmers should start learning how to mine coal...

load more comments (1 replies)
[–] floofloof@lemmy.ca 0 points 4 months ago (2 children)

I'm curious about what the "upskilling" is supposed to look like, and what's meant by the statement that most execs won't hire a developer without AI skills. Is the idea that everyone needs to know how to put ML models together and train them? Or is it just that everyone employable will need to be able to work with them? There's a big difference.

[–] Gormadt@lemmy.blahaj.zone 0 points 4 months ago

I know how to purge one off of a system, does that count?

load more comments (1 replies)
[–] lemmyvore@feddit.nl 0 points 4 months ago (1 children)

If you go forward 12 months the AI bubble will have burst. If not sooner.

Most companies who bought into the hype are now (or will be soon) realizing it's nowhere near the ROI they hoped for, that the projects they've been financing are not working out, that forcing their people to use Copilot did not bring significant efficiency gains, and more and more are realizing they've been exchanging private and/or confidential data with Microsoft and boy there's a shitstorm gathering on that front.

[–] Nighed@sffa.community 0 points 4 months ago (1 children)

If you have the ability to build an AI app in house - holy shit shit that can improve productivity. Copilot itself for office use.... Meh so far.

load more comments (1 replies)
[–] dinckelman@lemmy.world 0 points 4 months ago (3 children)

I'll take "things business people dont understand" for 100$.

No one hires software engineers to code. You're hired to solve problems. All of this AI bullshit has 0 capability to solve your problems, because it can only spit out what it's already ~~stolen from~~ seen somewhere else

[–] HakFoo@lemmy.sdf.org 0 points 4 months ago

It can also throw things against the wall with no concern for fitness-to=purpose. See "None pizza, left beef".

load more comments (2 replies)
[–] MangoPenguin@lemmy.blahaj.zone 0 points 4 months ago

I wonder how they think that's possible, the attempts I've made at having an "AI" produce working code have failed spectacularly.

[–] jubilationtcornpone@sh.itjust.works 0 points 4 months ago (1 children)

I seem to recall about 13 years ago when "the cloud" was going to put everyone in IT Ops out of a job. At least according to people who have no idea what the IT department actually does.

"The cloud" certainly had an impact but the one thing it definitely did NOT do was send every system and network admin to the unemployment office. If anything it increased the demand for those kinds of jobs.

I remain unconcerned about my future career prospects.

[–] MeekerThanBeaker@lemmy.world 0 points 4 months ago

Yes... because there will be users who will always refuse to fix their own computer issues. Even if there's an easy solution at their fingertips. Many don't even try to reboot. They just tell IT to fix it... then go get coffee for a half hour.

Says the person who is primarily paid with Amazon stock, wants to see that stock price rise for their own benefit, and won’t be in that job two years from now to be held accountable. Also, who has never written a kind of code. Yeah…. Ok. 🤮

[–] Vipsu@lemmy.world 0 points 4 months ago (2 children)

As software developer I am not scared that A.I will take away our jobs. What I am scared is that at that point A.I good enough to do most jobs out there.

All it really needs to do is replace large chunk of the service industry to do wreck massive havock in our society.

[–] sunzu2@thebrainbin.org 0 points 4 months ago

Connecting human existence to their labour has a designed defect

load more comments (1 replies)
[–] TheGrandNagus@lemmy.world 0 points 4 months ago (4 children)

24 months from now? Unlikely lol

[–] geogle@lemmy.world 0 points 4 months ago (1 children)

I'm sure they'll hold strong to that prediction in 24 mo. It's just 24 more months away

[–] A7thStone@lemmy.world 0 points 4 months ago (2 children)

We'll have full self driving next year.

[–] geogle@lemmy.world 0 points 4 months ago

This is the year of the Linux Desktop

[–] AceFuzzLord@lemm.ee 0 points 4 months ago* (last edited 4 months ago) (5 children)

I remember a little over a decade ago while I was still in public school hearing about super advanced cars that had self driving were coming soon, yet we're hardly anywhere closer to that goal (if you don't count the Tesla vehicles running red lights incidents).

load more comments (5 replies)
[–] lurch@sh.itjust.works 0 points 4 months ago (1 children)

15 years at least. probably more like 30. and it will be questionable, because it will use a lot of energy for every query and a lot of resources for cooling

[–] otp@sh.itjust.works 0 points 4 months ago

it will use a lot of energy for every query and a lot of resources for cooling

Well, so do coders. Coffee can be quite taxing on the environment, as can air conditioning!

load more comments (2 replies)
[–] casmael@lemm.ee 0 points 4 months ago (10 children)

I know just enough about this to confirm that this statement is absolute horseshit

load more comments (10 replies)
load more comments
view more: next ›