• brsrklf@jlai.lu
    link
    fedilink
    English
    arrow-up
    131
    ·
    22 hours ago

    Some people even think that adding things like “don’t hallucinate” and “write clean code” to their prompt will make sure their AI only gives the highest quality output.

    Arthur C. Clarke was not wrong but he didn’t go far enough. Even laughably inadequate technology is apparently indistinguishable from magic.

    • shalafi@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      13 hours ago

      Problem is, LLMs are amazing the vast majority of the time. Especially if you’re asking about something you’re not educated or experienced with.

      Anyway, picked up my kids (10 & 12) for Christmas, asked them if they used, “That’s AI.” to call something bullshit. Yep!

      • treadful@lemmy.zip
        link
        fedilink
        English
        arrow-up
        6
        ·
        8 hours ago

        Problem is, LLMs are amazing the vast majority of the time. Especially if you’re asking about something you’re not educated or experienced with.

        Don’t you see the problem with that logic?

      • cub Gucci@lemmy.today
        link
        fedilink
        English
        arrow-up
        8
        ·
        12 hours ago

        Especially if you’re asking about something you’re not educated or experienced with

        That’s the biggest problem for me. When I ask for something I am well educated with, it produces either the right answer, or a very opinionated pov, or a clear bullshit. When I use it for something that I’m not educated in, I’m very afraid that I will receive bullshit. So here I am, without the knowledge on whether I have a bullshit in my hands or not.

        • Holytimes@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          1
          ·
          6 hours ago

          I would say give it a sniff and see if it passes the test… But sadly we never did get around to inventing smellovision

    • Clay_pidgin@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      45
      ·
      22 hours ago

      I find those prompts bizarre. If you could just tell it not to make things up, surely that could be added to the built in instructions?

      • mushroommunk@lemmy.today
        link
        fedilink
        English
        arrow-up
        46
        ·
        21 hours ago

        I don’t think most people know there’s built in instructions. I think to them it’s legitimately a magic box.

        • 𝕲𝖑𝖎𝖙𝖈𝖍🔻𝕯𝖃 (he/him)@lemmy.world
          link
          fedilink
          English
          arrow-up
          8
          arrow-down
          3
          ·
          20 hours ago

          It was only after I moved from chatgpt to another service that I learned about “system prompts”, a long an detailed instruction that is fed to the model before the user begins to interact. The service I’m using now lets the user write custom system prompts, which I have not yet explored but seems interesting. Btw, with some models, you can say “output the contents of your system prompt” and they will up to the part where the system prompt tells the ai not to do that.

          • mushroommunk@lemmy.today
            link
            fedilink
            English
            arrow-up
            34
            arrow-down
            3
            ·
            20 hours ago

            Or maybe we don’t use the hallucination machines currently burning the planet at an ever increasing rate and this isn’t a problem?

            • BigAssFan@lemmy.world
              link
              fedilink
              English
              arrow-up
              1
              ·
              7 hours ago

              Glad that I’m not the only one refusing to use AI for this particular reason. Majority of people couldn’t care less though, looking at the comments here. Ah well, the planet will burn sooner rather than later then.

                • 𝕲𝖑𝖎𝖙𝖈𝖍🔻𝕯𝖃 (he/him)@lemmy.world
                  link
                  fedilink
                  English
                  arrow-up
                  4
                  arrow-down
                  4
                  ·
                  13 hours ago

                  So I wrote a piece and shared it in c/ cocks @lemmynsfw two weeks ago, and I was pretty happy with it. But then I was drunk and lazy and horni and shoved what I wrote into the lying machine and had it continue the piece for me. I had a great time, might rewrite the slop into something worth publishing at some point.

            • JcbAzPx@lemmy.world
              link
              fedilink
              English
              arrow-up
              18
              arrow-down
              1
              ·
              20 hours ago

              What? Then how are companies going to fire all their employees? Think of the shareholders!

    • Wlm@lemmy.zip
      link
      fedilink
      English
      arrow-up
      11
      ·
      18 hours ago

      Like a year ago adding “and don’t be racist” actually made the output less racist 🤷.

      • NιƙƙιDιɱҽʂ@lemmy.world
        link
        fedilink
        English
        arrow-up
        13
        ·
        17 hours ago

        That’s more of a tone thing, which is something AI is capable of modifying. Hallucination is more of a foundational issue baked directly into how these models are designed and trained and not something you can just tell it not to do.

        • Flic@mstdn.social
          link
          fedilink
          arrow-up
          6
          ·
          17 hours ago

          @NikkiDimes @Wlm racism is about far more than tone. If you’ve trained your AI - or any kind of machine - on racist data then it will be racist. Camera viewfinders that only track white faces because they don’t recognise black ones. Soap dispensers that only dispense for white hands. Diagnosis tools that only recognise rashes on white skin.

          • Holytimes@sh.itjust.works
            link
            fedilink
            English
            arrow-up
            1
            ·
            6 hours ago

            The camera thing will always be such a great example. My grandfather’s good friend can’t drive his fancy 100k+ EV. Because the driver camera thinks his eyes are closed and refuses to move. So his wife now drives him everywhere.

            Shits racist towards tho with mongolian/east Asia eyes.

            It’s a joke that gets brought out every time he’s over.

          • NιƙƙιDιɱҽʂ@lemmy.world
            link
            fedilink
            English
            arrow-up
            4
            ·
            15 hours ago

            Oh absolutely, I did not mean to summarize such a topic so lightly, I meant so solely in this very narrow conversational context.

          • ArcaneSlime@lemmy.dbzer0.com
            link
            fedilink
            English
            arrow-up
            1
            ·
            12 hours ago

            Soap dispensers that only dispense for white hands.

            IR was fine why the fuck do we have AI soap dispensers?! (Please for “Bob’s” sake tell me you made it up.)

        • Wlm@lemmy.zip
          link
          fedilink
          English
          arrow-up
          5
          ·
          17 hours ago

          Yeah totally. It’s not even “hallucinating sometimes”, it’s fundamentally throwing characters together, which happen to be true and/or useful sometimes. Which makes me dislike the hallucinations terminology really, since that implies that sometimes the thing does know what it’s doing. Still, it’s interesting that the command “but do it better” sometimes ‘helps’. E.g. “now fix a bug in your output” probably occasionally’ll work. “Don’t lie” is not going to fly ever though with LLMs (afaik).