• ooterness@lemmy.world
          link
          fedilink
          English
          arrow-up
          7
          ·
          18 hours ago

          For mental health? Yes, a robot that says “you’re absolutely right” to every prompt is as dangerous as a loaded gun.

          • cecilkorik@piefed.ca
            link
            fedilink
            English
            arrow-up
            4
            ·
            18 hours ago

            Yes, a robot that says “you’re absolutely right” to every prompt

            Worse than that, a robot that can construct conversations so convincingly that people are misled into thinking it is a genuine fellow intelligence and is being sold to us as a miraculous technological panacea that can solve all problems and says “you’re absolutely right” to every prompt. It’s the combination of apparent legitimacy and relentless utter bullshit that makes it so dangerous. Either one on its own wouldn’t be so bad. People are good at disregarding bullshit as long as they can determine that it might be bullshit. However when they’ve been convinced the source is an authority, and the authority is telling them bullshit and relentlessly leading onwards into further bullshit, they will accept it without further question. We see this happen in cults, and many other places in our society, but never on this scale.

            AI is an illusion, but it’s a very convincing one. Any snake oil salesman would be jealous of what a good show it puts on.