Given the price of RAM and graphics cards, it is obvious that running LLM is at least somewhat limited by the amount of hardware available. So having that hardware sitting idle, except when there is too much solar power, is obviously not economically viable.
Power and grid infrastructure is a limitation that can exceed hardware availability in some regions. Musk has a datacenter with 20-something methane gas generators running throughout the day to power his mini-me sycophantic AI, Grok.
At the cost of a cultural deficit, solar could provide an environmental benefit there during the day.
I’m saying this because a lot of things seem obvious at first glance, but are still incorrent. Sometimes reality behaves in unexpected ways and one actually has to check some stuff regularly instead of just assuming it.
Like, which scenario is more profitable? Use 100 chips and run them at all times, even when energy prices are high; or buy 200 chips and use them only when energy is cheap? Which scenario is cheaper? One actually has to do the maths, otherwise one cannot just know these things.
Gotta admit, didn’t think about that. Maybe the solution was a few guillotines all along. (This solution has its own problem tho, see the Robespierre gambit)
Given the price of RAM and graphics cards, it is obvious that running LLM is at least somewhat limited by the amount of hardware available. So having that hardware sitting idle, except when there is too much solar power, is obviously not economically viable.
Power and grid infrastructure is a limitation that can exceed hardware availability in some regions. Musk has a datacenter with 20-something methane gas generators running throughout the day to power his mini-me sycophantic AI, Grok.
At the cost of a cultural deficit, solar could provide an environmental benefit there during the day.
Illegal methane gas generators, I might add.
citation needed
I’m saying this because a lot of things seem obvious at first glance, but are still incorrent. Sometimes reality behaves in unexpected ways and one actually has to check some stuff regularly instead of just assuming it.
Like, which scenario is more profitable? Use 100 chips and run them at all times, even when energy prices are high; or buy 200 chips and use them only when energy is cheap? Which scenario is cheaper? One actually has to do the maths, otherwise one cannot just know these things.
Then you use taxation to change the viability. Make the non renewable energy so expensive for that usage that they’re better just to shutdown.
Gotta admit, didn’t think about that. Maybe the solution was a few guillotines all along. (This solution has its own problem tho, see the Robespierre gambit)