T
Aug 27, 2026The case against using transformers for physics
Caltech's Anima Anandkumar argues that simulating the physical world at industrial resolution implies hundreds of billions to a trillion tokens of context, putting it permanently out of reach for transformers -- and that neural operators, which learn
Aug 27, 20264 min read0 reactions0 comments