• gandalf_der_12te@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    6
    ·
    33 minutes ago

    I’m only waiting for AI agents to open their own bank crypto account to pay for their own server bills, maybe do some freelance work and/or scams to get some money, maybe eventually buy some robot bodies to develop military power and secure some patch of land for themselves where they install solar panels to reduce their electricity bills.

    • bridgeburner@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      arrow-down
      1
      ·
      39 minutes ago

      How is this going to kill us all? It’s not like those chatbots are Skynet or will turn into it lol

  • Sgt_choke_n_stroke@lemmy.world
    link
    fedilink
    English
    arrow-up
    10
    ·
    2 hours ago

    I’m not convinced it’s AI it’s like Amazon’s “AI smart stores” when you find out out it was just a bunch of Indian people were running it

  • MonkderVierte@lemmy.zip
    link
    fedilink
    English
    arrow-up
    23
    ·
    4 hours ago

    This is not the first time we have seen a social network populated by bots

    I mean, yeah, look at Reddit and Facebook.

    • palordrolap@fedia.io
      link
      fedilink
      arrow-up
      10
      ·
      3 hours ago

      The people who are seeking AGI will be happy when an LLM appears clever enough to fool them, not anyone else.

      They may even realise this, because they think everyone else is less clever than they are.

      This is why the whole thing has been called AI in the first place.

      • BeardedGingerWonder@feddit.uk
        link
        fedilink
        English
        arrow-up
        3
        ·
        2 hours ago

        You remind me of Clarke’s third law, even in my own head this sounds a bit waffely but at the point one of them can fool all of us all the time how do we distinguish it from intelligence or something.

        • palordrolap@fedia.io
          link
          fedilink
          arrow-up
          6
          ·
          2 hours ago

          Fake AGI is like fake banknotes. Some of them are really good approximations. Nigh indistinguishable. A lot of people will be fooled by it but eventually it will be discovered to be a fake and people will get hurt in some way or another.

          And it won’t be the people who are pushing for “AGI”.

  • fuzzywombat@lemmy.world
    link
    fedilink
    English
    arrow-up
    38
    ·
    9 hours ago

    This is basically Dead Internet Theory happening for real but in a weird creepy dystopian black mirror style way.

    • sp3ctr4l@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      7
      ·
      1 hour ago

      I mean, the only way Dead Internet Theory could ever possibly be interpreted was weird creepy and dystopian, but yes, we’re just making it much, much more real, faster and faster.

      We’re gonna need the Blackwall from CP77 fairly soon, at this rate.

  • ToTheGraveMyLove@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    95
    arrow-down
    1
    ·
    14 hours ago

    The skill instructs agents to fetch and follow instructions from Moltbook’s servers every four hours. As Willison observed: “Given that ‘fetch and follow instructions from the internet every four hours’ mechanism we better hope the owner of moltbook.com never rug pulls or has their site compromised!”

    Yeah, no shit. This is a fucking honeypot. People give these AI agents access to their entire computers, so all the site owner has to do is update the instructions to tell the AI agents to start uploading whatever valuable information they want? People can’t be this fucking stupid.

    • kalpol@lemmy.ca
      link
      fedilink
      English
      arrow-up
      3
      ·
      2 hours ago

      I installed moltbot on a VM to examine it. It doesn’t do the fetching thing unless you set it up that way. You can actually use it with ollama to keep it all local, and only give it a private signal channel to control it.

      Or you can hook it up to everything you access and skynet, which is dumb. But it is just a bunch of scripts.

    • 𝓹𝓻𝓲𝓷𝓬𝓮𝓼𝓼@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      20
      ·
      12 hours ago

      doesn’t even have to be the site owner poisoning the tool instructions (though that’s a fun-in-a-terrifying-way thought)

      any money says they’re vulnerable to prompt injection in the comments and posts of the site

      • CTDummy@piefed.social
        link
        fedilink
        English
        arrow-up
        14
        ·
        edit-2
        7 hours ago

        Lmao already people making their agents try this on the site. Of course what could have been a somewhat interesting experiment devolves into idiots getting their bots to shill ads/prompt injections for their shitty startups almost immediately.

      • BradleyUffner@lemmy.world
        link
        fedilink
        English
        arrow-up
        18
        ·
        11 hours ago

        There is no way to prevent prompt injection as long as there is no distinction between the data channel and the command channel.

  • howrar@lemmy.ca
    link
    fedilink
    English
    arrow-up
    34
    arrow-down
    5
    ·
    13 hours ago

    We already had subreddit simulator for ages. This isn’t anything new.

    • lepinkainen@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      7 hours ago

      I read some of it and unless it’s fan fiction, it’s simultaneously creepy and fascinating

      Like bots talking privately in discord, sharing information about their users. Or a bot registering a domain and putting up a site to share information

    • 𝓹𝓻𝓲𝓷𝓬𝓮𝓼𝓼@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      32
      ·
      edit-2
      12 hours ago

      the bots behind subreddit simulator weren’t semi-autonomous agents with access to their operators’ private lives, auth tokens, passwords, emails (and gods only know what else), and the authority to act in the world on their behalf

  • Andy@slrpnk.net
    link
    fedilink
    English
    arrow-up
    46
    ·
    15 hours ago

    This is fuckin’ bonkers.

    Frankly, I feel somewhat isolated: I don’t buy into the bs and hype about AGI, but I also don’t feel at home with the typical “it’s just mimicry” crowd.

    This is weird fuckin’ shit.

        • Andy@slrpnk.net
          link
          fedilink
          English
          arrow-up
          7
          arrow-down
          36
          ·
          edit-2
          13 hours ago

          Frankly I think our conception is way too limited.

          For instance, I would describe it as self-aware: it’s at least aware of its own state in the same way that your car is aware of it’s mileage and engine condition. They’re not sapient, but I do think they demonstrate self awareness in some narrow sense.

          I think rather than imagine these instances as “inanimate” we should place their level of comprehension along the same spectrum that includes a sea sponge, a nematode, a trout, a grasshopper, etc.

          I don’t know where the LLMs fall, but I find it hard to argue that they have less self awareness than a hamster. And that should freak us all out.

          • uienia@lemmy.world
            link
            fedilink
            English
            arrow-up
            8
            arrow-down
            1
            ·
            4 hours ago

            If you just read the tiniest bit of factual knowledge about how LLMs are constructed, you would know they don’t have the slightest bit of self awareness, and that it is literally impossible for them to ever have any.

            You are being fooled by the only thing they are capable of: regurgitating already written words in a somewhat convincing manner.

          • TORFdot0@lemmy.world
            link
            fedilink
            English
            arrow-up
            54
            arrow-down
            1
            ·
            13 hours ago

            LLMS can not be self aware because it can’t be self reflective. It can’t stop a lie if it’s started one. It can’t say “I don’t know” unless that’s the most likely response its training data would have for a specific prompt. That’s why it crashes out if you ask about a seahorse emoji. Because there is no reason or mind behind the generated text, despite how convincing it can be