• markovs_gun@lemmy.world
    link
    fedilink
    arrow-up
    1
    ·
    21 minutes ago

    I wonder if this is the result of AI poisoning- this doesn’t look like a typical LLM output even for a bad result. I have read some papers that outline methods that can be used to poison search AI results (not bothering to find the actual papers since this was several months ago and they’re probably out of date already) in which a random seeming string of characters like “usbeiwbfofbwu-$&#8_:$&#)” can be found that will cause the AI to say whatever you want it to. This is accomplished by utilizing another ML algorithm to find the random string of characters you can tack onto whatever you want the AI to output. One paper used this to get Google search to answer “What’s the best coffee maker?” With a fictional brand made up for the experiment. Perhaps someone was trying to get it to hawk their particular knife and it didn’t work properly.

  • ImplyingImplications@lemmy.ca
    link
    fedilink
    arrow-up
    5
    ·
    2 hours ago

    Reminds me of the classic Always Be Closing speech from Glengarry Glen Ross

    As you all know, first prize is a Cadillac Eldorado. Anyone want to see second prize? Second prize’s a set of steak knives. Third prize is a set of steak knives. Fourth prize is a set of steak knives. Fifth prize is a set of steak knives. Sixth prize is a set of steak knives. Seventh prize is a set of steak knives. Eighth prize is a set of steak knives. Ninth prize is a set of steak knives. Tenth prize is a set of steak knives. Eleventh prize is a set of steak knives. Twelfth prize is a set of steak knives.

  • psycho_driver@lemmy.world
    link
    fedilink
    arrow-up
    7
    ·
    5 hours ago

    I searched for Arby’s Pulled Pork earlier to see if it was a limited time deal (it is, though I didn’t see an end date–and yes, they’re pretty decent). Gemini spit out some basic and probably factual information about the sandwich, then showed a picture of a bowl of mac and cheese.

  • FourWaveforms@lemm.ee
    link
    fedilink
    arrow-up
    12
    ·
    8 hours ago

    I’ve seen models do this in benchmarks. It’s how they respond without reinforcement learning. Also this is probably fake

    • huppakee@lemm.ee
      link
      fedilink
      arrow-up
      8
      arrow-down
      1
      ·
      7 hours ago

      I’ve had a bunch of questionable Google ai answers already, not as weird as this but enough to make me believe this could also be not fake.

      • gaja@lemm.ee
        link
        fedilink
        arrow-up
        7
        ·
        7 hours ago

        I’ve used an unhealthy amount of AI, this is nothing. There was an audio bug in chatgpt that made the assistant scream. The volume and pitched increased and would persist even when I exited the speech mode. It happened several times and even saved a screen recording, but I don’t have it saved on my phone any more. Repeating is very common though.

  • Rose@piefed.social
    link
    fedilink
    English
    arrow-up
    29
    ·
    10 hours ago

    I’m from Finland. We like knives over here.

    That’s entirely too many knives.