• 7 Posts
  • 67 Comments
Joined 1 year ago
cake
Cake day: June 10th, 2023

help-circle


  • Considering that predicting the next word from context is the one thing LLMs are really good at, I just don’t understand how none of these developments have found their way into predictive keyboards.

    The problem is that LLMs require a considerable amount of computing power to run, unlike the simple markov chain predictions that keyboards use. You could use a cloud-based service like ChatGPT or something, but most people wouldn’t want their keyboards to send all their keystrokes to a remote server… and even if they didn’t know or care, the response time wouldn’t be good enough for real-time predictions.

    Now smartphone SoC makers like Qualcomm have started adding NPUs (neural processing units) with their latest chips (such as the SD8 Gen 3, featured in the most recent flagship phones), but it’s going to take a while before devices with NPUs become commonplace, and it’ll take a while for developers to start making/updating apps that can make use of it.

    But yeah the good news is that it is coming, it’s only a matter of “when” - I suspect it won’t be long before the likes of SwiftKey start to take advantage of this.



















  • What does surprise me is that people actually pay their own subscription for these platforms. Netflix had a win in profit/revenue. I’m surprised that these people did not go for the Piracy method even though, they complain about:

    Most people don’t like change. Maybe they have a habit of switching on Netflix daily during dinner or something. There’s also a big “Netflix” button on their remotes and their TV’s homescreen, which serves as a constant reminder. They probably even have the app on their phones. All of this leads to mental conditioning and addiction, it’s now a part of their daily lives. Humans are a creature of habit, and it’s hard to break out of a routine ingrained over several years.

    Piracy could be a option for some people, but it’s still either too technical, or not as convenient, for the average Joe. Sure, there are even websites you could simply go to without installing any app, but most people won’t bother with that - they just want to hit a single button on their remote/TV and watch something, without needing to go to some website, a website which may eventually stop working.

    You’ll find that most people would prefer to take the path of least resistance, even if it means paying (more) money. Don’t forget that even pirates may sometimes pay money to make things easier - eg usenet/seedbox/debrid users - and that’s simply because they too would prefer to take the path of least resistance, even if it means being in the ironic situation of paying to watch pirated content. So it’s not too hard to imagine why normal people would just prefer to cough up the extra cash for Netflix and continue with their lives, routines unchanged.