• Lovable Sidekick@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 days ago

    Wouldn’t surprise me if an LLM trained on records of chess moves made good chess moves. I just wouldn’t expect the deployed version of ChatGPT to generate coherent chess moves based on the general text it’s been trained on.

    • nednobbins@lemm.ee
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 days ago

      I wouldn’t either but that’s exactly what lmsys.org found.

      That blog post had ratings between 858 and 1169. Those are slightly higher than the average rating of human users on popular chess sites. Their latest leaderboard shows them doing even better.

      https://lmarena.ai/leaderboard has one of the Gemini models with a rating of 1470. That’s pretty good.