Meta, the forward march of progress

Just in case you don't want to click over to the other sites, Big Zuck update

– Open sourcing will continue
– Currently training LLama 3
– AI + Metaverse
– Will have 350,000 H100s and ~600 H100 equivalents of compute 🤯
-Ideal AI formfactor is 🕶️ pic.twitter.com/xJSi7yVzXe

— Alex Volkov (Thursd/AI) (@altryne) January 18, 2024

According to one estimate, that is about $20 billion spent on GPUs. Which I guess is a lot.