The Pre-Training Wall and the Treadmill After It copertina

The Pre-Training Wall and the Treadmill After It

The Pre-Training Wall and the Treadmill After It

Ascolta gratuitamente

Vedi i dettagli del titolo

Offerte di stagione | 0,99 €/mese per i primi 3 mesi

A seguire 9,99 €/mese – si applicano condizioni. Puoi disdire mensilmente.
A proposito di questo titolo

I've been confusing Don with frontier-lab links late at night for a bit.

Ilya Sutskever told a NeurIPS audience that pre-training as we know it would unquestionably end. There's only one internet, and the data isn't growing. The frontier labs call this the pre-training wall.

A leaked Google memo from 2023 argued they had no moat. R1 is on GitHub. Llama is on Hugging Face. OpenAI's secondary-market valuation has climbed past $850 billion.

Don was confused. So he came over and we made an episode about it.

  • Episode Page
  • Support The Show
  • Subscribe To The Podcast
  • Join The Newsletter

adbl_web_anon_alc_button_suppression_t1
Ancora nessuna recensione