Some models like Nemotron use open datasets, and utilize hardware more efficiently than OpenAI and such.
Its (IMO) also quite different when the weights are Apache licensed. If absolutely zero profit is involved, that gets close to the “fair use” umbrella, IMO, like other noncommercial derivative works of restrictively licensed content (fanfics/fanart).
You are not wrong about the closed datasets though, for the vast majority of LLMs. Lord knows what the Chinese trainers or OpenAI use to train…
But anything truly “open weights” is still a different order of magnitude in the ethics scale, IMO. I view the primary issue to be profiting off the scraping and training; take that away, and its not nearly as egregious.
Some models like Nemotron use open datasets, and utilize hardware more efficiently than OpenAI and such.
Its (IMO) also quite different when the weights are Apache licensed. If absolutely zero profit is involved, that gets close to the “fair use” umbrella, IMO, like other noncommercial derivative works of restrictively licensed content (fanfics/fanart).
You are not wrong about the closed datasets though, for the vast majority of LLMs. Lord knows what the Chinese trainers or OpenAI use to train…
But anything truly “open weights” is still a different order of magnitude in the ethics scale, IMO. I view the primary issue to be profiting off the scraping and training; take that away, and its not nearly as egregious.