this post was submitted on 28 Feb 2025
160 points (98.2% liked)

Technology

63375 readers
7075 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each other!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed
  10. Accounts 7 days and younger will have their posts automatically removed.

Approved Bots

founded 2 years ago
MODERATORS
L3s@lemmy.world
enu@lemmy.world
technopagan@lemmy.world
L4s@lemmy.world
160
OpenAI CEO Sam Altman says his company is 'out of GPUs' to which I reply 'welcome to the party, pal' (www.pcgamer.com)
submitted 9 hours ago by misk@sopuli.xyz to c/technology@lemmy.world
19 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] tal@lemmy.today 5 points 5 hours ago* (last edited 5 hours ago)

Of course, Altman is referring to chonky enterprise-grade GPUs like those used in the Nvidia DGX B200 and DGX H200 AI platforms—the latter of which OpenAI was the first to take delivery of last year.

You wouldn't be using these for gaming (well, not of the 3D graphics sort).

They run in the tens of thousands of dollars each, as I recall.

Probably more correct to call them "parallel compute accelerator" cards than "GPUs". I don't think that they have a video out, even.

What they do have is a shit-ton of on-board RAM.

EDIT: Oh, apparently those are whole servers containing multiple GPUs.

https://www.trgdatacenters.com/resource/nvidia-dgx-buyers-guide-everything-you-need-to-know/

The NVIDIA DGX B200 is a physical server containing 8 Blackwell GPUs offering 1440GB RAM and 4TB system memory. It also includes 2 Intel CPUs and consumes 14.3kW power at max capacity.

For comparison, the most powerful electric space heater I have draws about a tenth that.

DGX H200 systems are currently available for $400,000 – $500,000. BasePOD and SuperPOD systems must be purchased directly from NVIDIA. There is a current waitlist for B200 DGX systems.