There are models being marketed as being therapy dispensing models that in their terms of service are correctly described as entertainment and not endorsed by actual therapists because what AI therapy actually is is just a tool that tricks users into being their own unlicensed therapists. AI “therapy” flatters negativity bias and agrees with whatever it’s users think sounds right about themselves walking people into danger.
We are in the zone of cocaine being available over the counter for toothaches here. Companies are being legitimately reckless in their marketing and AI is a black box by nature where companies cannot tell what is happening inside their products, they can only test them without having the manpower and counter ingenuity to test everything. If any other product lead to the death of multiple consumers or demonstrates harm to multiple people you usually pull it from the shelves and go back to the drawing board.
There are models being marketed as being therapy dispensing models that in their terms of service are correctly described as entertainment and not endorsed by actual therapists because what AI therapy actually is is just a tool that tricks users into being their own unlicensed therapists. AI “therapy” flatters negativity bias and agrees with whatever it’s users think sounds right about themselves walking people into danger.
We are in the zone of cocaine being available over the counter for toothaches here. Companies are being legitimately reckless in their marketing and AI is a black box by nature where companies cannot tell what is happening inside their products, they can only test them without having the manpower and counter ingenuity to test everything. If any other product lead to the death of multiple consumers or demonstrates harm to multiple people you usually pull it from the shelves and go back to the drawing board.