I actually have a 3B running on my Home Assistant, an 8th gen NUC with 16G of RAM I got for $175. It’s quite snappy… if not terribly correct about everything. It’s capable of running an 8B but then the response time on the Voice PE is too slow to suit me (goes from 3 seconds to about 8 seconds).
I actually have a 3B running on my Home Assistant, an 8th gen NUC with 16G of RAM I got for $175. It’s quite snappy… if not terribly correct about everything. It’s capable of running an 8B but then the response time on the Voice PE is too slow to suit me (goes from 3 seconds to about 8 seconds).
What model are you running?
Qwen 2.5.
Can it be used for agentic workflows or just simple Q and A?