I’d like to set up a local coding assistant so that I can stop using Google to ask complex questions to for search results.
I really don’t know what I’m doing or if there’s anything that’s available that respects privacy. I don’t necessarily trust search results for this kind of query either.
I want to run it on my desktop, Ryzen 7 5800xt + Radeon RX 6950xt + 32gb of RAM. I don’t need or expect data center performance out of this thing. I’m also a strict Sublime user so I’d like to avoid VS Code suggestions as much as possible.
My coding laptop is an oooooold MacBook Air so I’d like something that can be ran on my desktop and used from my laptop if possible. No remote access needed, just to use from the same home network.
Something like LM Studio and Qwen sounds like it’s what I’m looking for, but since I’m unfamiliar with what exists I figured I would ask for Lemmy’s opinion.
Is LM Studio + Qwen a good combo for my needs? Are there alternatives?
No, thank you. Sorry, never.
Not only that, but the huge probability of mistakes is just deafening. The last time I used LLM was in 2023 someone recommended for a task at paper work, and I got a literal headache in 10 minutes… Since then I never ever will use that sorrow for anything that is not for blackbox pentesting or experimental unverified data generated you may find in medicine or military isolated solutions.
That deafening feel that every single bit of output from that LLM or void machine may contain a mistake no soul is accountable for to ask about… A generated bit of someone’s work you just cannot verify since no source nor human is available… How would you trace the rationale that resulted in the output shown?
Faster? Is that so… Doesn’t verification of every output require even more time to test it and consider stable, to prove it is correct, to stay accountable for the knowledge and actions you perform as a developer, artist, researcher… human?
Your mind is to be trained to do a research, remember, and do not depend on someone’s service to a level of predominance/replacement.
Meanwhile, effort, passion, creativity, empathy, and love, in turn, you carry, supports in long-term.
You may not care now, though, but you do you. It’s your mind and memory you develop.
Maybe you should check 5hat again. I never used llm before 2025, but proved itself useful for a few tasks. Yes check and verification still needed, but indeed made my life easier and got taken done faster. Quality was still a good as what I could do myself. Maybe that doesn’t speak well of myself I don’t know.