coja@lemmy.mltoSelfhosted@lemmy.world•What would be the cheapest and most cost-effeciant way of self hosting LLMs
3·
7 months agoNot sure about the setup, but I believe 7600XT would be the best buy, it has 16GB VRAM and it’s supported now
Not sure about the setup, but I believe 7600XT would be the best buy, it has 16GB VRAM and it’s supported now
Try Voyager