New Theory Suggests Chatbots Can Understand Text | Quanta Magazine
www.quantamagazine.org
Far from being “stochastic parrots,” the biggest large language models seem to learn enough skills to understand the words they’re processing.

I’ve been saying this for about a year since seeing the Othello GPT research, but it’s nice to see more minds changing as the research builds up.

  • expr@programming.devEnglish
    1·
    10 months ago

    They’re not wrong. Randomness in computing is what we call “pseudo-random” in that it is deterministic provided that you start from same state or “seed”.