• 0 Posts
  • 194 Comments
Joined 7 months ago
cake
Cake day: August 26th, 2024

help-circle

  • Yes, Kurzweil desperately trying to create some kind of a scientific argument, as well as people with university affiliations like Singer and MacAskill pushing EA, are what give this stuff institutional strength. Yudkowsky and LW are by no means less influential, but they’re at best a student club that only aspires to be a proper curriculum. It’s surely no coincidence that they’re anchored in Berkeley, adjacent to the university’s famous student-led DeCal program.

    FWIW, my capsule summary of TPOT/“post-rationalists” is that they’re people who thought that advanced degrees and/or adjacency to VC money would yield more remuneration and influence than they actually did. Equally burned out, just further along the same path.


  • I’ve been contemplating this, and I agree with most everyone else about leaning heavily into the cult angle and explaining it as a mutant hybrid between Scientology-style UFO religions and Christian dispensationalist Book of Revelation eschatology. The latter may be especially useful in explaining it to USians. My mom (who works in an SV-adjacent job) sent me this Vanity Fair article the other day about Garry Tan grifting his way into non-denominational prosperity gospel Christianity: https://www.vanityfair.com/news/story/christianity-was-borderline-illegal-in-silicon-valley-now-its-the-new-religion She was wondering if it was “just another fad for these people,” and I had to explain no, not really, it is because their AI bullshit is so outlandish that some of them feel the need to pivot back towards something more mainstream to keep growing their following.

    I also prefer to highlight Kurzweil’s obsession with perpetual exponential growth curves as a central point. That’s often what I start with when I’m explaining it all to somebody. It provides the foundation for the bullshit towers that Yudkowsky and friends have erected. And I also think that long-term, the historiography of this stuff will lean more heavily on Kurzweil as a source than Yudkowsky, because Kurzweil is better-organized and professionally published. It’ll most likely be the main source in the lower-division undergraduate/AP high school history texts that highlight this stuff as a background trend in the 2010s/2020s. Right now, we live in the peak days of the LessWrong bullshit volcano plume, but ultimately, it will probably be interpreted by the specialized upper-division texts that grow out of peoples’ PhD theses.

    awful.systems







  • Notwithstanding the subject matter, I feel like I’ve always gotten limited value from these Oxford-style university debates. KQED used to run a series called Intelligence Squared US that crammed it into an hour, and I shudder to think what that’s become in the era of Trump and AI. It seems like a format that was developed to be the intellectual equivalent of intramural sports, complete with a form of scoring. But that contrivance renders it devoid of nuance, and also means it can be used to platform and launder ugly bullshit, since each side has to be strictly pro- or anti-whatever.

    Really, it strikes me as a forerunner of the false certainty and point-scoring inherent in Twitter-style short-form discourse. In some ways, the format was unconsciously pared down and plopped online, without any sort of inquiry into its weaknesses. I’d be interested to know if anyone feels any different.