Seriously. Neural networks can approximate literally any function, and the lumbering giants have all decided ‘what’s the next word?’ is the only function worth pursuing.
It’d take a sliver of their current budget to try starting over like it’s 2020. Compare with benchmarks that now look quaint. Enjoy some wisdom where previously they could only guess. Buuut nope: all LLM, all the time, and big big big.
Seriously. Neural networks can approximate literally any function, and the lumbering giants have all decided ‘what’s the next word?’ is the only function worth pursuing.
It’d take a sliver of their current budget to try starting over like it’s 2020. Compare with benchmarks that now look quaint. Enjoy some wisdom where previously they could only guess. Buuut nope: all LLM, all the time, and big big big.