A new study from Columbia Journalism Review showed that AI search engines and chatbots, such as OpenAI’s ChatGPT Search, Perplexity, Deepseek Search, Microsoft Copilot, Grok and Google’s Gemini, are just wrong, way too often.

  • venotic@kbin.melroy.org
    link
    fedilink
    arrow-up
    10
    arrow-down
    4
    ·
    23 hours ago

    Then again, so has the search engines themselves been proven to be wrong, inaccurate and just plain irrelevant. I’ve asked questions in Google before about things I need to know in general about my state out of curiosity and it’s results always pull up different states that do not apply to mine.

    • TheFogan@programming.dev
      link
      fedilink
      English
      arrow-up
      20
      arrow-down
      2
      ·
      21 hours ago

      well that’s common, but the big thing is, you can see what you are working with. Big difference in at least knowing you need to try a different site when say

      Google: Law about X in state1

      Top result: Law about X in state3: It’s illegal

      Result 2 pages in: here’s a list of each page and whether law X is legal in your state… (State 1 legal)

      Versus chatgpt

      Is X legal in state1?

      Chatgpt: No

    • catloaf@lemm.ee
      link
      fedilink
      English
      arrow-up
      11
      arrow-down
      1
      ·
      21 hours ago

      Yeah because you’re not supposed to ask search engines questions, you’re supposed to use keywords.