this post was submitted on 22 Nov 2024
53 points (76.2% liked)
Technology
59566 readers
3407 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Infrastructure in this case refers to the data centers and LLMs. It takes hundreds of megawatt hours to train a single current-gen LLM and who knows how many gigawatts of energy are being consumed by the sum of LLMs at any given point but it likely dwarfs the sum of all energy spent training LLMs.
But then there's the energy involved in producing those cards, shipping those cards, the data centers themselves.
It wouldn't be preposterous to suggest that the sum of energy spent at any given time on generative AI is enough to power New York City. Might even be well more than
No, in this case I'm referring to the electric grid and what powers it.