• 0 Posts
  • 1.53K Comments
Joined 10 months ago
cake
Cake day: February 10th, 2025

help-circle


  • iPhone notification summaries were made with GPT3.5 I believe (maybe even the -turbo version).

    It doesn’t use reasoning and so when using very short outputs it can produce wild variations since there are not a lot of previous tokens in order to direct the LLM into the appropriate direction in kv-space and so you’re more at the whims of temperature setting (randomly selecting the next token from a SOFTMAX’d list which was output from the LLM).

    You can take those same messages and plug them into a good model and get much higher quality results. But good models are expensive and Apple is, for some reason, going for the budget option.


  • Anyone learning a new language massively benefits from being able to speak with native speakers.

    That being said, LLMs are better at languages and translation tasks than any pretty much anything else. If you need vocabulary help or have difficulty with grammar they’re incredibly helpful (vs Googling and hoping someone had the same issue and posted about it on Reddit).

    I mean, if you can afford a native speaker tutor that is the superior choice. But, for the average person, an LLM is a massive improvement over trying to learn via YouTube or apps.





  • Unless you’re incredibly rich, a terrorist or otherwise wanted by an intelligence service or going to DEFCON the chances of you being targeted with a Spectre-like attack is almost zero. I don’t think there has been a single, large scale attack using this family of exploits.

    These are spook exploits, not steal your credit card and bitcoins exploits.




  • I don’t know the details or the bills, but it isn’t uncommon for people in contested seats to be allowed by the party to vote in a poll-favorable way when their vote won’t change the outcome.

    Simply, counting ‘Times voted with Trump’ doesn’t say much that is useful and can be misleading, especially in the context of a post about death threats to politicians.

    Social media can have a very us or them mentality. If you’re not 100% lock step with the group then you’re an enemy to be scored and attacked. I read that comment as 'Yeah, they’re getting death threats but they voted with Trump so they deserved it (<insert Nazi bar comment>)".



  • Thanks for the recommendation, I’ll look into GLM Air, I haven’t looked into the current state of the art for self-hosting in a while.

    I just use this model to translate natural language into JSON commands for my home automation system. I probably don’t need a reasoning model, but it doesn’t need to be super quick. A typical query uses very few tokens (like 3-4 keys in JSON).

    The next project will be some kind of agent. A ‘go and Google this and summarize the results’ agent at first. I haven’t messed around much with MCP Servers or Agents (other than for coding). The image models I’m using are probably pretty dated too, they’re all variants of SDXL and I stopped messing with ComfyUI before video generation was possible locally, so I gotta grab another few hundred GB of models.

    It’s a lot to keep up with.😮‍💨


  • Ah.

    GloriousEggroll keeps a version of proton that uses all of steam updates plus additional updates made by the community (to fix odd issues) and protonfixes (a database of scripts to make the weird game-specific configurations you need to make sometimes). I use it exclusively because I’ve had issues with regular Proton. I think the default Proton versions are still version 9(or there’s an experimental Wine 10 version). GE-Proton10 is using Wine 10, so it has support for native Wayland and HDR.

    Your distro probably has protonup-qt in its repo. It’s a GUI to download and install various community proton versions. Just run it, click install new version and grab the latest GE-Proton10-(28?) and restart Steam and it’ll show up in the list of Proton versions that you can pick.