• Anna@lemmy.ml
    link
    fedilink
    arrow-up
    61
    arrow-down
    1
    ·
    10 hours ago

    I work in a regulated sector and our higher ups are pushing AI so much. And there response to AI hallucinations is to just put a banner on all internal AI tools to cross verify and have some quarterly stupid “trainings” but almost everyone I know never checks and verifies the output. And I know of atleast 2 instances where because AI hallucinated some numbers we sent out extra money to a third party.

    • SocialMediaRefugee@lemmy.world
      link
      fedilink
      arrow-up
      8
      ·
      6 hours ago

      It reminds me of when the internet exploded in the 90s and everyone “needed” a website. Even my corner gas station had a web presence for some reason. Then with smartphones everyone needed their own app. Now with AI everyone MUST use AI everywhere! If you don’t you are a fool and going to get left behind! Do you know what you actually need it for? Not really but some article you read said you could fire 50% of your staff if you do.

      • NannerBanner@literature.cafe
        link
        fedilink
        arrow-up
        4
        ·
        4 hours ago

        I would quite honestly prefer every place to have their own web site instead of the ginormous amount of places that have facebook pages.

    • wizardbeard@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      31
      ·
      9 hours ago

      My workplace (finance company) bought out an investments company for a steal because they were having legal troubles, managed to pin it on a few individuals, then fired the individuals under scrutiny.

      Our leadership thought the income and amount of assets they controlled was worth the risk.

      This new group has been the biggest pain in the ass. Complete refusal to actually fold into the company culture, standards, even IT coverage. Kept trying to sidestep even basic stuff like returning old laptops after upgrades.

      When I was still tech support, I had two particularly fun interactions with them. One was when it was discovered that one of their top earners got fired for shady shit, then they discovered a month later that he had set his mailbox to autoreply to every email pointing his former clients to his personal email. Then, they hired back this guy and he lasted a whole day before they caught him trying to steal as much private company info as he could grab. The other incident was when I got a call from this poor intern they hired, then dumped the responsibility for this awful home grown mess of Microsoft Access, Excel, and Word docs all linked over ODBC on this kid. Our side of IT refused to support it and kept asking them to meet with project management and our internal developers to get it brought up into this century. They refused to let us help them.

      In the back half of last year, our circus of an Infosec Department finally locked down access to unapproved LLMs and AI tools. Officially we had been restricted to one specific one by written policy, signed by all employees, for over a year but it took someone getting caught by their coworker putting private info into a free public chatbot for them to enforce it.

      Guess what sub-company is hundreds of thousands of dollars into a shadow IT project that has went through literally none of the proper channels to start using an explicitly disallowed LLM to process private customer data?

      • ChickenLadyLovesLife@lemmy.world
        link
        fedilink
        English
        arrow-up
        9
        ·
        6 hours ago

        My last job was with a very large west coast tech giant (its name is a homonym with an equally-large food services company). The mandatory information security training was a series of animated shorts featuring talking bears which you could fast-forward through and still get credit for completing. Not surprisingly, we had major data thefts every few months – or more accurately we admitted to major data thefts that often.