SimPPL

Pratyush Maini on X: \"1/Pretraining is hitting a data wall; scaling raw web data alone leads to diminishing returns....

Source
https://x.com/pratyushmaini/status/1957456720265154752?s=12
Tags
llmstrainingtwitter

Permalink: simppl.org/library/item/pratyush-maini-on-x-1-pretraining-is-hitting-a-data-wall-scaling-raw-w-f4e6e349

This is a SimPPL canonical link to a reading shared in our newsletter. Browse the rest at simppl.org/library.