i was able to get gpt to say “yes” when asking about genocide. it did at first reply with nuanced sources, more “yes” than no, about 80:20. But when i flat told it to consider mechanism of injury, counts, rhetoric, comparisons to current/recent genocides … it said “yes.”
Not even what it hears most, it is very biased towards reinforcing the prompt text.So it will very expressly try to be an echo chamber and say ‘yes’ to whatever opinion the input suggests if plausible.
I have seen a few TikToks lately of Christians showing ChatGPT conversations where it says that Christianity is the best religion (by whatever metric it’s talking about). It’s like, why would anyone find that convincing? The machine that lies isn’t some sort of source of truth.
i was able to get gpt to say “yes” when asking about genocide. it did at first reply with nuanced sources, more “yes” than no, about 80:20. But when i flat told it to consider mechanism of injury, counts, rhetoric, comparisons to current/recent genocides … it said “yes.”
AI only repeats what it hears most. It doesn’t form an opinion of its own
Not even what it hears most, it is very biased towards reinforcing the prompt text.So it will very expressly try to be an echo chamber and say ‘yes’ to whatever opinion the input suggests if plausible.
I have seen a few TikToks lately of Christians showing ChatGPT conversations where it says that Christianity is the best religion (by whatever metric it’s talking about). It’s like, why would anyone find that convincing? The machine that lies isn’t some sort of source of truth.
yep it’s a stochastic parrot