Meta, the forward march of progress
Just in case you don't want to click over to the other sites, Big Zuck update
– Open sourcing will continue
– Currently training LLama 3
– AI + Metaverse
– Will have 350,000 H100s and ~600 H100 equivalents of compute 🤯
-Ideal AI formfactor is 🕶️ pic.twitter.com/xJSi7yVzXe— Alex Volkov (Thursd/AI) (@altryne) January 18, 2024
According to one estimate, that is about $20 billion spent on GPUs. Which I guess is a lot.