AI
“The amount of compute needed to train Llama 4 will likely be almost 10 times more than what we used to train Llama 3.”
"AI systems should be overseen by people, rather than by automation, to prevent harmful outcomes."
"We see significant value in open foundation models to help strengthen cybersecurity, increase competition, and promote innovation.”
"Indiscriminately learning from data produced by other models causes... a degenerative process whereby, over time, models forget the true underlying data distribution."
"We're just scratching the surface of what's possible, and we're taking steps to seize opportunities down the road..."
"We were able to install and bring online a massive new training centre in nineteen days. That's the fastest by far that anyone's been able to do that."