The Picard Maneuver@piefed.world to Lemmy Shitpost@lemmy.worldEnglish · 8 hours agoSeems legitmedia.piefed.worldexternal-linkmessage-square36fedilinkarrow-up1366arrow-down16
arrow-up1360arrow-down1external-linkSeems legitmedia.piefed.worldThe Picard Maneuver@piefed.world to Lemmy Shitpost@lemmy.worldEnglish · 8 hours agomessage-square36fedilink
minus-squareDarkCloud@lemmy.worldlinkfedilinkarrow-up43·8 hours agoYou can get offline versions of LLMs.
minus-squareGhostalmedia@lemmy.worldlinkfedilinkEnglisharrow-up2·4 hours agoI mean, most people have a local LLM in their pocket right now.
minus-squaresp3ctr4l@lemmy.dbzer0.comlinkfedilinkEnglisharrow-up2·edit-24 hours agoI’ve been toying with Qwen3. On my steam deck. 8 bil param model runs stably. Its’s opensource too! Alpaca is a neat little flatpak that containerizes everything and makes running local models so easy that I can literally do it without a mouse or keyboard.
minus-squarecriss_cross@lemmy.worldlinkfedilinkarrow-up10·7 hours agoAnd gpt-oss is an offline version of chatgpt
minus-squareutopianfiat@lemmy.worldlinkfedilinkEnglisharrow-up8·7 hours agoIndeed https://huggingface.co/openai-community
minus-squarelinkinkampf19 🖤🩶🤍💜🇺🇦@lemmy.worldlinkfedilinkEnglisharrow-up5·7 hours agoFirst thing that came to mind: GPT4All
You can get offline versions of LLMs.
https://ollama.org/
I mean, most people have a local LLM in their pocket right now.
I’ve been toying with Qwen3.
On my steam deck.
8 bil param model runs stably.
Its’s opensource too!
Alpaca is a neat little flatpak that containerizes everything and makes running local models so easy that I can literally do it without a mouse or keyboard.
And gpt-oss is an offline version of chatgpt
Indeed https://huggingface.co/openai-community
First thing that came to mind: GPT4All