• AwesomeLowlander@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    1
    arrow-down
    1
    ·
    5 hours ago

    All it needs is enough tech ability to run a few docker commands. That has absolutely nothing to do with LLMs. Not to mention the horrifying intrusion on our rights by limiting what we can host.

    • theneverfox@pawb.social
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      4 hours ago

      Yeah, that’s what I want them to do. I want them to install docker, run some commands, correctly identify their graphics card and driver, and get the networking right. Then I want them to pick the model they want and download it

      It’s not about making it hard, it’s about having a level of understanding about how this all works. If you’re using AI, I shouldn’t have to explain to you that it can’t search the Internet unless you manually give it that ability. I shouldn’t have to explain that the LLM is just a file, not some magical Internet djinn

      Not to mention the horrifying intrusion on our rights by limiting what we can host.

      Umm… You don’t have the right to host anything you want. You can’t host CSAM, copyrighted things, and you have to comply with tons of laws if you want user content