this post was submitted on 24 Jul 2024
20 points (57.4% liked)

Technology

59091 readers
5286 users here now

This is a most excellent place for technology news and articles.

Our Rules

  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots

founded 1 year ago
MODERATORS
[email protected]
[email protected]
[email protected]
[email protected]
20
Elon Musk claims he is training “the world’s most powerful AI by every metric” (arstechnica.com)
submitted 3 months ago by [email protected] to c/[email protected]
44 comments fedilink hide all child comments
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 5 points 3 months ago* (last edited 3 months ago)

Well, it says 100k H100s.

Looks like an H100 is 700W.

looks at WP's table of the TOP500 list of supercomputers

https://en.wikipedia.org/wiki/TOP500

The top entry there -- has, as accelerator cards, 36,992 MI250Xs, which are apparently 500W each.

It's the highest compute card count other than one using Intel Max 1550s, which has 63,744 cards, which are 600W each.

I'm not sure that the TOP500 is necessarily the best ranking here, since I don't know if it's the best metric for GPU-style compute, and the CPUs are also a factor. But at least going off what he's saying, it'd probably rank above those for GPU power consumption (and compute capacity).