You must log in or register to comment.
Offline LLMs exist but tend to have a few terabytes of base data just to get started (e.g. before LORAs)
Could you crunch an LLM into 700Mb that was still functional? Cause this looks like a fun thing to actually do as a joke.
Edit, I bet I could get https://huggingface.co/distilbert/distilgpt2 to run off a CD. How many tps am I gonna get guys 🤣
Does anyone know of any OSS LLMs that can search the web the way ChatGPT can?
Depends. Does ChatGPT ignore robots.txt too?
FCKGW-RHQQ2-YXRKT-8TG6W-2B7Q8
make sure to disconnect the internet first
CrAcKeD
You can get offline versions of LLMs.
I’ve been toying with Qwen3.
On my steam deck.
8 bil param model runs stably.
Its’s opensource too!
Alpaca is a neat little flatpak that containerizes everything and makes running local models so easy that I can literally do it without a mouse or keyboard.
I mean, most people have a local LLM in their pocket right now.
And gpt-oss is an offline version of chatgpt
First thing that came to mind: GPT4All
If we assume a CD, you can probably fit a 256M parameters model in it. But it will LOAD.
DVDs exist. They can fit approx. 7B params, enough to be somewhat productive.
It’s just audio of French farting cats.
Le pfffft.
That’s just Dr Sbaitso.
It reminds me of the Britannica Encyclopedia on CD.
Encarta 95
Maybe they meant GTA?
Isn’t it possible to download all of wikipedia, and it being surprisenly a small file size? Can it fit on a CD?
It could fit on a BDXL disc.
You can fit text-only wikipedia on a normal Blu Ray as it’s only about 24GB. You can also easily fit Llama 3.1 or any of the other open, offline capable ai models as they’re only about 4GB.
could also store it on a flashdrive or micro sd card
The full 2025-04 English-only ZIM dump is about 120 GB. That includes reduced-size images as well as all articles. I think the text-only version is in the 40-60 GB range.
There are smaller ZIM versions in the ~4 GB range that would fit on a DVD, but they’re only a subset for specific topics or for a list of the most popular topics.
No, you really can’t; It’s like 43 gb the text only version
So gonna need like 2 CDs then
No
(English) 24,05GB without media. Adding media adds 428,36TB.
500TB is still surprisingly reasonable for what is essentially a library of human (surface level) knowledge.
It would be interesting to know how large the file would be including all text form references (i’d imagine anything else such as videos would completely blow the proportions)
Can you give me the text only version link? I found only a version that is like 43gb
I suggest the happy medium called Kiwix, directly from the programme you can download all of Wikipedia with medium-sized pictures for a hundred gigabytes or so.
The sizes I mentioned are from around 2023-2024, from https://en.wikipedia.org/wiki/Wikipedia:Size_of_Wikipedia
https://dumps.wikimedia.org/enwiki/ (https://en.wikipedia.org/wiki/Wikipedia:Database_download)
KiwiX on mobile gives 111.1GB Wikipedia download, It also has a bunch of diff categories if you don’t want the super large one.
kiwix? that’s compressed (afaik), and when i tried, it took up half of my disk space and needed ethernet
