Skip to content
Tech News
← Back to articles

Here’s What the AI Apocalypse Could Look Like

read original more articles
Why This Matters

This exchange highlights growing skepticism among tech journalists about AI industry rhetoric, specifically the shift from 'AGI' to 'recursive self-improvement' as the latest buzzword framing AI's supposed existential risks. The conversation matters because it questions whether fear-based AI narratives are genuine safety concerns or marketing tactics designed to attract investment while discouraging regulation.

Key Takeaways

Brian Barrett: It's also, and we talked about this with Will a little bit last week, but I still can't get over, the thing that everyone seems to be most worried about is this idea of recursive self-improvement where AI starts building the next AI. An AI model builds the next AI model and so on and so forth until you get this exponential progress in AI and we don't know how it works anymore, we don't know how to control it. And I'm a simpleton, I'm a simple guy, but why not just don't do that? Why not just don't do that? How about that? If we're all so worried about that, how about we just don't? Zoë, you can yell at me now, but why don't we just not?

Zoë Schiffer: OK. No, no, no, no. I don't want to yell. I just want to go back to something Leah said at the very top, which is how much of this is marketing. I just think it's so baffling to me that we were all talking about AGI for so long, and that was the big milestone and the big thing that everyone was heading toward, and we had to get to AGI before China and blah, blah, blah. And then all of a sudden RSI just kind of replaced it because AGI didn't seem as likely. And now RSI is being used in very, very, very similar ways. It's like, actually, this is the thing that's going to be really scary and we need to get to this milestone before China. I'm just like, are we just going to keep coming up with scary three-letter acronyms to talk about AI's power in a way that makes regulation less likely and AI investment a lot more likely?

Leah Feiger: Zoë, everything you just said, I couldn't agree with you more. Wow. Wow.

Brian Barrett: When really, the real three-letter acronym is IPO. Huh? Did that work? Did I do it?

Zoë Schiffer: Wow.

Brian Barrett: Is that something?

Leah Feiger: I didn't know where you were going.

Zoë Schiffer: Trying to get in on this.

Leah Feiger: You just want to be part of this.

Brian Barrett: Successfully. What do you mean? Trying to get in on it. Succeeding.

... continue reading