• leadore@lemmy.world
    link
    fedilink
    arrow-up
    8
    ·
    7 hours ago

    Welcome to Garbage In/Garbage Out (GIGO). Formally, in AI circles, this is known as AI model collapse. In an AI model collapse, AI systems, which are trained on their own outputs, gradually lose accuracy, diversity, and reliability.

    In other words, don’t shit where you eat.

  • sp3ctr4l@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    29
    ·
    17 hours ago

    Full Quote:

    If we all reacted the same way, we’d be predictable, and there’s always more than one way to view a situation. What’s true for the group is also true for the individual.

    It’s simple: Overspecialize, and you breed in weakness. It’s slow death.

    We have had fictional, nearly 100% cybernetic characters understanding this kind of obvious problem since 30+ years ago.

    • SoftestSapphic@lemmy.world
      link
      fedilink
      arrow-up
      10
      ·
      10 hours ago

      It’s like the smart people who built this shit aren’t the same ones selling it.

      Even Sam Altman has said the current models hit a wall like 3 years ago.

      And instead of us accepting that fact and waiting patiently for the smart people to find a new fundamentally different approach we are just supplying these models with exponentially more power for exponentially diminishing returns.

      • sp3ctr4l@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        5
        ·
        edit-2
        8 hours ago

        That hype exists the way it does because the global economy has been stalling out (now, it beginning to crash).

        Capitalism demands the impossible, which is constantly increasing rates of return in a world of finite resources and growing maintenance costs for what already exists.

        Capitalism does this by destroying the environment and sucking dry, cannibalizing the consumer base / employees.

        Capitalism stops working when there is nothing left to suck, and everything is literally on fire.

        But if you lie hard enough, to enough people, for a long enough time, you might be able to keep wile e coyote floating in the air just a bit longer before he remembers gravity exists.

        Everything is so insanely financialized now that if you now miss a margin, well that negative impact is systemic and orders of magnitude more dire.

        Remote Work was killed off because, even though it literally is more productive in most cases, literally more efficient from an operational standpoint of a business, for the worker, for the environment, for infrastructure…

        … Well it would have caused a collapse in the commerical real estate market, can’t have that.

        Oh, that and it also revealed that… most managers are actually negatively good at their jobs, actively harmful toward productivity.

        A CEO or Board of Directors are literally a million times easier to automate with existing AI than the millions of different kinds of jobs.

        I’ve done a number of executive level data analyst jobs. All the board does is read my numbers and use their rolodex, make phone calls to their buddies in other businesses.

        But for some funny reason, no companies are slashing the pay and options plans of their astoundingly most expensive employees.

        🤔

        Why could that possibly be?!

      • sp3ctr4l@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        10 hours ago

        Yesiree, the excitement never stops!

        :D

        i thought what i’d do is pretend i was one of those deaf mutes i thought what i’d do is pretend i was one of those deaf mutes i thought what i’d do is pretend i was one of those deaf mutes i thought what i’d do is pretend i was one of those deaf mutes i thought what i’d do is pretend i was one of those deaf mutes i thought what i’d do is pretend i was one of those deaf mutes i thought what i’d do is pretend i was one of those deaf mutes

  • snooggums@lemmy.world
    link
    fedilink
    English
    arrow-up
    54
    arrow-down
    1
    ·
    22 hours ago

    I was all like “Yeah, suck it AI! You will never be better than the average person!” But then…

    Welcome to Garbage In/Garbage Out (GIGO). Formally, in AI circles, this is known as AI model collapse. In an AI model collapse, AI systems, which are trained on their own outputs, gradually lose accuracy, diversity, and reliability. This occurs because errors compound across successive model generations, leading to distorted data distributions and “irreversible defects” in performance. The final result? A Nature 2024 paper stated, “The model becomes poisoned with its own projection of reality.”

    Oh, so basically the same kind of thing as conservatives huffing their own propaganda. Maybe AI is a solid reflection of our worst traits.

    Then I remembered that we solved that issue with computers already by having output be consistent and reliable.