• 1 Post
  • 83 Comments
Joined 7 months ago
cake
Cake day: March 22nd, 2024

help-circle

  • I would only use the open source models anyway, but it just seems rather silly from what I can tell.

    I feel like the last few months have been an inflection point, at least for me. Qwen 2.5, and the new Command-R, really make a 24GB GPU feel “dumb, but smart,” useful enough so I pretty much always keep Qwen 32B loaded on the desktop for its sheer utility.

    It’s still in the realm of enthusiast hardware (aka a used 3090), but hopefully that’s about to be shaken up with bitnet and some stuff from AMD/Intel.

    Altman is literally a vampire though, and thankfully I think he’s going to burn OpenAI to the ground.


  • What are people doing with these super expensive boards now? Like, I know there’s always the “top 1% first-person-shooter” niche that wants that last sub-millisecond of latency, playing games that don’t really respond to 3D cache, but… what else? That’s not a big niche. Modern CPUs have like no overclocking headroom, and even at stock are pushed way too hard.

    I’d only spend that kind of money on an embedded Strix Halo board, or HEDT with tons of PCIe lanes. I just don’t see why you’d shell out for Arrow Lake like that when you can get 95% of the performance for a fraction of the price and power usage elsewhere.



  • Good.

    All this bill would have done is given OpenAI/Anthropic and such an effective monopoly (and probably destroy the planet with their insane scaling schemes) by destroying the open model ecosystem. I think fediverse vs. corporate social media is a good analogy, and this is kinda like sniping the Fediverse because it’s “too dangerous” if it gets too big, without actually being specific on how to deal with that, but actually sniping it because its a competitive threat.

    And yes, OpenAI opposed this, but that was lip service. Don’t believe a word that comes out of Altman’s mouth.





  • brucethemoose@lemmy.worldtoTechnology@lemmy.worldBe careful.
    link
    fedilink
    English
    arrow-up
    6
    ·
    edit-2
    19 days ago

    The behavior is configurable just like it is on linux, UAC can be set to require a password every time.

    But I think its not set this way by default because many users don’t remember their passwords, lol. You think I’m kidding, you should meet my family…

    Also, scripts can do plenty without elevation, on linux or Windows.







  • Jokes aside (and this whole AI search results thing is a joke) this seems like an artifact of sampling and tokenization.

    I wouldn’t be surprised if the Gemini tokens for XTX are “XT” and “X” or something like that, so it’s got quite a chance of mixing them up after it writes out XT. Add in sampling (literally randomizing the token outputs a little), and I’m surprised it gets any of it right.




  • On my G14, I just uses the ROG utility to disable turbo and make some kernel tweaks. I’ve used ryzenadj before, but its been awhile. And yes I measured battery drain in the terminal (but again its been awhile).

    Also throttling often produces the opposite result in terms of extended battery life as it likely takes more time in the higher states to do the same amount of work whereas running at a faster clock speed, the work is completed faster and the CPU returns to a lower less energy using state quicker and resides there more of the time.

    “Race to sleep” is true to some extent, but after a certain point the extra voltage one needs for higher clocks dramatically outweighs the benefit of the CPU sleeping longer. Modern CPUs turbo to ridiculously inefficient frequencies by default before they thermally throttle themselves.