• Septimaeus@infosec.pub
    link
    fedilink
    English
    arrow-up
    1
    ·
    27 days ago

    I mean, you can have that today, in some form or other, since that’s just how local AI works.

    • Nouvellalia@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      26 days ago

      Totally. It’s a bit pricey for anything like a genuine personal assistant right now though. $15k or so to get the basics.

      • Septimaeus@infosec.pub
        link
        fedilink
        English
        arrow-up
        2
        ·
        26 days ago

        Atm the meta for local inference is unified memory and “routed” local agents (multiple smaller role-specific agents in a trench coat)

        The former is standout for cost efficiency (e.g., 4x RDMA 48gb Minis for a 192gb cluster @ $0.43/gb vs a $45k b200 alone)

        The latter is standout for many things, including resource efficiency on smaller machines

        • Nouvellalia@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          26 days ago

          That’ll surely work to automate simple mental labor or tasks, but I don’t think a swarm of minis is going to be able to provide impactful personal and psychosocial analysis of your life.

          • Septimaeus@infosec.pub
            link
            fedilink
            English
            arrow-up
            1
            ·
            25 days ago

            Fair enough, though I’m not sure personal and psychological analysis of your life is something AI should ever be entrusted with.