cm0002@lemmy.world to Technology@lemmy.worldEnglish · 5 个月前Majority of AI Researchers Say Tech Industry Is Pouring Billions Into a Dead Endfuturism.comexternal-linkmessage-square174fedilinkarrow-up1853arrow-down118cross-posted to: [email protected]
arrow-up1835arrow-down1external-linkMajority of AI Researchers Say Tech Industry Is Pouring Billions Into a Dead Endfuturism.comcm0002@lemmy.world to Technology@lemmy.worldEnglish · 5 个月前message-square174fedilinkcross-posted to: [email protected]
minus-squaredeegeese@sopuli.xyzlinkfedilinkEnglisharrow-up110·5 个月前Optimizing AI performance by “scaling” is lazy and wasteful. Reminds me of back in the early 2000s when someone would say don’t worry about performance, GHz will always go up.
minus-squareNoiseColor @lemmy.worldlinkfedilinkEnglisharrow-up29arrow-down2·5 个月前Thing is, same as with GHz, you have to do it as much as you can until the gains get too small. You do that, then you move on to the next optimization. Like ai has and is now optimizing test time compute, token quality, and other areas.
minus-square🇸🇵🇪🇨🇺🇱🇦🇹🇪🇷@lemmy.worldlinkfedilinkEnglisharrow-up8·5 个月前To be fair, GHz did go up. Granted, it’s not why modern processors are faster and more efficient.
minus-squarech00f@lemmy.worldlinkfedilinkEnglisharrow-up20·5 个月前https://en.wikipedia.org/wiki/Wirth's_law
minus-squareAdrianTheFrog@lemmy.worldlinkfedilinkEnglisharrow-up2·5 个月前 don’t worry about performance, GHz will always go up TF2 devs lol
minus-squaremorrowind@lemmy.mllinkfedilinkEnglisharrow-up1·5 个月前It always wins in the end though. Look up the bitter lesson.
Optimizing AI performance by “scaling” is lazy and wasteful.
Reminds me of back in the early 2000s when someone would say don’t worry about performance, GHz will always go up.
Thing is, same as with GHz, you have to do it as much as you can until the gains get too small. You do that, then you move on to the next optimization. Like ai has and is now optimizing test time compute, token quality, and other areas.
To be fair, GHz did go up. Granted, it’s not why modern processors are faster and more efficient.
https://en.wikipedia.org/wiki/Wirth's_law
TIL
TF2 devs lol
It always wins in the end though. Look up the bitter lesson.
I miss flash players.