AI update

We’re in that “a lot of people have stopped caring” phase of the transition, don’t let the status quo and recency biases fool you:

Google’s new flagship AI model, “Gemini,” is set to be a direct competitor to GPT-4 and boasts computing power 5 times that of GPT-4. Trained on Google’s TPUv5 chips, it’s capable of simultaneous operations with a massive 16,384 chips. The dataset used for training this model is around 65 trillion tokens, and it’s multi-modal, accepting text, video, audio, and pictures. Moreover, it can produce both text and images. The training also included content from YouTube and used advanced training techniques similar to “AlphaGo-type” methods. Google plans to release the Gemini model to the public in December 2023.

And that may or may not prove the most important event of that half year…