• 0 Posts
  • 11 Comments
Joined 10 months ago
cake
Cake day: March 22nd, 2024

help-circle

  • I’m talking text only, and there are some fundamental limitations in the way current and near future LLMs handle certain questions. They don’t “see” characters in inputs, they see words which get tokenized to their own internal vocabulary, hence any questions along the lines of “How many Ms are in Lemmy” is challenging even for advanced, fine tuned models. It’s honestly way better than image captchas.

    They can also be tripped up if you simulate a repetition loop. They will either give a incorrect answer to try and continue the loop, or if their sampling is overturned, give incorrect answers avoiding instances where the loop is the correct answer.



  • I mean, there’s a real issue.

    Say you were china, or the EU, or any other country/bloc and basically your entire youth was addicted to Twitter, Facebook or whatever, and officially manipulatable by the US government…. And you got into a real conflict. Maybe even a hot war.

    Wouldn’t you be worried about the US propagandizing your population?

    I would.

    The US government’s solution is completely dysfunctional and not getting at the root of the issue because they are afraid of reducing the power projection of big tech, among other things. But the core issue doesn’t need to be trivialized.