

Fund Waydroid!
He / They
Software Developer


Fund Waydroid!


Why would they touch llama.cpp? It’s open source and has ROCm support.


I like my maps with GMOs


I’ve found it to be true, but you’re right, anecdotal evidence is not necessarily true.


Which is bizarre, the best engineers are basement dwellers
erectile dysfunction executive dysfunction


Inertia, just like Facebook.
I have both SA and ED :(


Higher efficiency = less hardware demand


Local models tend to be more efficient since people will be more likely to run compressed and MoE models.
Also, it’s basically 1 GPU >= 1 request for the most part in data centres, each request is its own LLM. Each time you make a new request after a set timeout, model weights get loaded in VRAM, context gets initialized, the query gets parsed, and it spits out tokens. These frontier models can be 300 GB in size or more, which all needs to be kept in VRAM for best performance, usually distributed across multiple GPUs, and each loaded model can only answer one query at a time.
Compare this to someone like me, trying to cram Qwen 3.6 MoE on the 16 GB RX 6800XT I already have in my own computer, not using up drinking water or prime real estate to cool my PC, powered using hydroelectricity.
It’s so much more eco-friendly and economical, I wish frontier models would just die tbh, or at least only be used for distillation. LLMs offer diminishing returns past a certain point, and you can get 90% of the frontier model with a MoE local model.
Too bad, crée toi un courriel qui match ton compte lol


This isn’t even the case for those LG monitors, they trigger a Windows Update download for malware.


Sexualization of women x sexualization of prepuberty.
It’s pedophilia. You’re welcome.
Edit: Wow the downvotes came quick, please instruct yourselves.
https://ojs.stanford.edu/ojs/index.php/sjfgss/article/download/3103/1654/10396


Fash take, just kill it. LLMs should belong to the people, just like information should belong to the people.


Come on, GrowingPainz was right there


Attempting to make a self improving AI is like fucking your sister: in the search for perfection, you pollute your own dataset.


My work would be impossible without WSL, and yes I am guilty of hiding from the security systems… Because the security systems are so invasive they keep locking files I’m trying to open so IDEs don’t even work properly under Windows.


Yeah as if $100,000 wasn’t an arbitrary amount.
Alternative title:
More Than a Dozen Colleges Are Quietly Crossing the CA$138,182.50 Mark This Year
Don’t forget about “jerky”