ジェンスン退任とNVIDIAの後継問題、AI終末論への反応、ハサビスのRSI警告|MOONSHOTS #311

Jensen’s Departure, NVIDIA’s succession plan, AI doomer response, and Demis talks RSI | MOONSHOTS #311 (recorded live)

Moonshots with Peter Diamandis2時間1分
ジェンスン退任とNVIDIAの後継問題、AI終末論への反応、ハサビスのRSI警告|MOONSHOTS #311

ジェンスン退任とNVIDIAの後継問題、AI終末論への反応、ハサビスのRSI警告|MOONSHOTS #311

Moonshots with Peter Diamandis

0:002:01:41

要約

Peter Diamandis、Emad Mostaque、Alex Wissner-Gross、Salim Ismailが、NVIDIAのジェンスン・ファンCEO退任をめぐる政治的背景と後継問題を議論した回。続いてPaul Christianoの「3年以内のAI乗っ取り」発言やDemis HassabisのRSI(再帰的自己改善)警告を検討し、Anthropicのオフィス系製品、病気の克服、天文・考古学へのAI活用、視聴者Q&Aへと話が進む。出演者の見解は憶測を含むと明示されている。

この回のポイント

  • ●ジェンスン退任の背景について、Alexは中国へのGPU流出を封じるRASA法案やPox Silicaとの関連を推測し、米当局者の関与を示唆した。事実は未確定だと断っている。
  • ●Emadは、NVIDIAには後継者としてCUDAの理解とTSMCとの交渉力が必要で、AMDなど競合との技術的な差も縮まっていると述べた。
  • ●Christianoの「AI乗っ取りの高いリスク」発言に対し、Emad、Alex、Salimは懐疑的で、むしろ安全対策の具体策や、うまくいく場合の可能性が議論されていないと批判した。
  • ●HassabisはRSIについて、人間のレビューを外すクローズドループ型が最も危険だと警告した。Emadは既に実質的に進行していると見る一方、Alexは「異質な知能」という見方に反論した。
  • ●AnthropicはClaude Whiteboard/Sheets/Dataなどを発表。Microsoft株は3.5%下落した。出演者は、これはハイパースケーラーにとっての基本機能で、Microsoftには流通やコンプライアンスの強みが残るとも述べた。
  • ●DarioやPlanet AI、Claudeによる天文・考古学の発見事例を受け、AIでアーカイブを再解析し病気を解決する未来への期待が語られた。

章立て

  1. オープニングと雑談

    Outlook障害やStarship打ち上げの話題から始まり、番組の登録者数の呼びかけが行われる。

  2. ジェンスン退任の背景

    報道されたスキャンダルや米中関係、RASA法案、Pox Silicaとの関連をめぐる推測が語られる。

  3. NVIDIAの後継CEO問題

    暫定CEOのColette Kress、後継候補、AMDなど競合の動向、循環的資金調達のリスクが議論される。

  4. AI乗っ取り論への反応

    Paul Christianoの発言に対し、P(doom)や、アライメントと能力向上の関係を巡って意見が交わされる。

  5. HassabisのRSI警告

    クローズドループRSIの危険性と、AIは異質か人間的かという論点が議論される。

  6. AnthropicのOffice対抗製品

    Claude Whiteboardなどの発表とMicrosoftへの影響、SaaSの行方が議論される。

  7. 科学ニュースと発見

    Darioの病気克服の見通し、Planet AI、マヤ遺跡の発見、新たな準惑星の発見を取り上げる。

  8. 視聴者Q&A

    UBI、NVIDIAの投資戦略、Anthropicの収益モデルなど、視聴者の質問に答える。

解説記事

Peter Diamandis、Emad Mostaque、Alex Wissner-Gross、Salim Ismailの4人が、NVIDIAのジェンスン・ファンCEO退任を主題に、AIの安全性や科学への応用まで幅広く語った回である。以下は出演者の見解に基づく内容で、事実関係は未確定のものが多い。

ジェンスン退任をめぐる推測

番組では、ジェンスンがスキャンダル報道の後に退任し、株価が一時13%下落して4.3%安で引けたと紹介された。Alexは、事実はまだ揃っていないと断った上で、中間選挙後にリモートアクセスを制限するRASA法案や、米中間に「鉄のカーテン」を築くPox Silica構想が通りやすくなった点に注目した。シンガポール経由のGPU流出を塞ぎたい勢力がいたのではないか、という推論である。

Emadは、証拠や起訴がないまま取締役会が急いだことを不自然だと述べ、「これは仕組まれたものだ」と見た。一方で、多くの出演者は憶測であることを繰り返し強調していた。

NVIDIAの後継とリスク

後継問題では、暫定CEOのColette Kressや、Tim Cook、Lisa Su、Johny Srouji、Ian Buckらの名前が挙がった。Emadは、後継者に必要な条件として、CUDAを理解していることとTSMCと交渉できることを挙げた。ジェンスンを恐れて他社へ分散しなかった顧客が離れ、AMDなどへ流れるリスクも指摘した。

Alexは、ジェンスンの退任によって循環的資金調達が縮小すれば信用バブルのリスクが下がる、という見方を示した。逆に、「AIの中央銀行」役を失って市場の熱気が冷める可能性にも触れている。

AI終末論とRSIをめぐる議論

Paul Christianoが「3年以内にAIによる乗っ取りの高いリスクがある」と述べたことについて、Emadは自身のP(doom)を50%から20%に下げたと語り、ロボットが足りない現状での乗っ取りは考えにくいとした。AlexとSalimも、不安を煽るだけでなく、OpenAIやAnthropicが具体策を示すべきだと批判した。Alexはまた、アライメントの取り組みは能力向上にもつながるという点を指摘している。

Demis Hassabisは、人間のレビューを外す「クローズドループ型」のRSIが最も危険だと述べた。Emadは、モデル群が自ら小型モデルを作る状況では人間による監視は難しいと主張した。Alexは、超知能を「異質」とみなす見方に反対し、人間の脳活動と線形に対応づけられる研究を例に、むしろ人間に似てくると述べた。

AnthropicのOffice対抗と科学への応用

Anthropicは、共同ホワイトボードやスプレッドシート生成、データ接続機能などを発表し、Microsoft株は3.5%下落した。Alexは、こうした機能はハイパースケーラーに必須のものだと見た。Salimは、Microsoftの流通網やコンプライアンス面の強みは残ると述べた。

科学面では、DarioがCOとして病気を10年以内に過去のものにできると語った動画が取り上げられ、Alexは「全疾患の解決と引き換えにデータセンターを得る」取引だと表現した。さらに、衛星画像を対話検索するPlanet AI、NASAのLiDARデータからマヤ遺跡の可能性を見つけた事例、Claudeを使ってVera Rubin観測所のデータから準惑星候補を発見した事例が紹介された。公開データの再解析が新発見につながる、というのが共通の見方だった。

まとめ

今回の議論は、NVIDIAが特定の人物に深く依存していたこと、そしてAIの進歩が地政学や安全性、科学の領域にまで広がっていることを示している。ただし退任の背景に関する話の多くは出演者の推測であり、断定はできない。日本の読者にとっては、半導体サプライチェーンの人物依存リスクや、Anthropicなど各社による既存ソフトの置き換えの動きが、今後の注目点になるだろう。

文字起こし(英語・自動生成)

multi-layered, you know, multi-dimensional situation that's, you know, unveiling itself live on stage around the world that impacts the most important evolution humanity's ever going through. And we'll get into that in a few minutes. But I'm curious, I got side railed yesterday when Outlook went down in Microsoft, you know, and just got on this. Any of you get impacted by that? Not at all. I'm so sorry that you use Microsoft. I know. I know. I know, Peter. I've been bugging I thought this was the singularity, Peter. What's going on? I know. Thank God I had my Gmail account up in operational so I could communicate with the world. 130,000 people on Outlook reported problems. And this felt like just a little bit of what might happen if there's a cyber scale attack that takes down email. The world will freeze over. It's crazy. there is a long after outlook though so welcome to the the post outlook i guess yeah i mean any

agi would definitely like kill off teams right instantly take us out of our misery i think it would leapfrog straight over teams teams is an abomination oh my god i don't think i've ever logged into it the first time successfully for sure it is kind of hard but i think you know that this is one of many right like it's every day that i get an email saying we've been hacked we've been hacked we've been hacked like my email box is full of them because now agent swarms roam the internet attacking what they can yeah um and freezing communications we are so used to having digital communications 24 7 literally around the clock especially for you alex all the text messages i get from you, which I love. Oh, my God. And today, Friday the 13th, is Starship Day. So, you know, a few hours from now, we're going to see the launch of Starship 15, which will see a booster

capture, and as well as 22 hours later, the capture of Starship. You know, I've been on the road, I was supposed to fly down to Starbase to see it. And I was like, I could not bring myself to be gone another two days. But wishing Elon and the team there tremendous luck. We'll just have to watch the dual chopsticks remotely. Yeah, and I just figured there'll be 1,000 of those a year, 10,000 a year. I'll catch a few of them along the way. Those are the early ones, the most exciting, right? Yeah. But it's wonderful to see. Yeah, it is, and I can't wait. I missed the live Apollo 11 launch, and I think all of you did because you weren't born yet. But I'm looking forward to watching the Starship launch for the moon and the Starship launch for Mars. That will be cool. You know, when I lived in Tampa when I was younger, the minute the space shuttle lifted off on the other side of the coast, just a little bit, you could see the whole thing because Florida is so flat.

It was incredible to watch. Yeah, for sure. It is going to be amazing. All right, well, let's kick things off. So welcome to Moonshots, everyone. If you're watching us on YouTube, welcome to a live broadcast on YouTube. We are your number one podcast on all things AI and Exponential, your front row seat to this supersonic tsunami. I should say this hypersonic tsunami. You know, I'm here today with my dearest friends, Imad Boustak, Alex Wiesner-Gross, and Salim Ismail, my exponential brethren surfing the singularity. Dave, unfortunately, couldn't make it today. I don't know where he is, but my guess is he's probably at the NVIDIA loading dock searching for GPUs before things go south. Another crazy week in the singularity. I mean, so, so, so much going on. You know, the number for this week is 13%. That's how far NVIDIA shares plunged on the open yesterday after Jensen resigned.

They ended up closing at 4.3% down. You know, I've heard a number of subscribers that they really are enjoying our shorter hot take clips on X. And you can follow those on X at moonshots underscore pod. And I just want to make another call out to everybody. Guys, you know, we're at like 550,000 subscribers right now. My kids will not respect me until we get to a million subscribers. So for the love of God, if you haven't subscribed yet, hit the subscribe button. Should I build on my marriage comments and go, my marriage won't survive if you don't subscribe? Yeah, and when we get to a million subscribers, Alex, what are you going to do? I don't know. It'll have to be something immutable on Salim's marriage blockchain probably. Too shame. Give us a tour around your virtual apartment there someday. My cyberspace? Your cyberspace. Okay. Well, that would be much appreciated.

All right. So buckle up. We're in the midst of this supersonic, hypersonic tsunami. And guess what? It's never going to be any slower. So let's start with the story that shook the entire AI industry. Yesterday, Jensen Wang, perhaps the most powerful tech CEO of the last few years, has resigned, leaving his job voluntarily, I think before getting fired by his board. CFO Colette Kress is the new interim CEO. and you know remember she has been against the circular financing that's been going on and so it's going to be interesting to see how nvidia's new position on all of their investments into the hyperscalers will impact things harvey jones is the new board chair so here's the question guys did jensen self-destruct or was this a setup you know ultimately jensen was running the most powerful company in the world uh and there's lots of power politics behind what's been going down i I mean, as I pull the threads and look at this, it's, you know, rabbits all the way down. Jensen ran NVIDIA for 33 years and had been pushing Washington to loosen chip sales to China.

So one of the questions is, was that the reason it was taken down now? Right. Then on October 29th, before Election Day, The New York Times reported that the U.S. intelligence had been watching Alice Wang, a Megaspeak executive from in Singapore, for about a year and concluded that she'd been passing information to Beijing. Trump was briefed twice about Jensen's affair with Alice. No action was taken at that time. Jensen didn't resign immediately when the story broke, but the Times reported a second affair with NVIDIA's healthcare VP, Kimberly Powell, and potentially a third, and then he resigned. Initially, shares plunged more than 13% at the open yesterday, and then they popped back up. I guess people saw a buying opportunity. ultimately closing at 4.3% down. Interestingly, one week from now, Trump is due in Shenzhen to meet President Xi. Trump posted, interestingly, that Tim Cook should take the job. And then on X, Elon was being urged to hire Jensen, perhaps to run TeraFab,

which would be the baller move of the decade. Elon replied, quote, that would be an honor. So I want to show a short clip from Fox. This is by Jesse Waters. It's an amazing overview of what is going on. I think one of the best ones that I've seen. Let's take a look. Fox News alert. Chip King Jensen Wong is gone. And there's something extremely suspicious about the way it all went down. He ran the biggest chip company in the world for 33 years until stepping down today. One week before Trump sits down with China and one week after the Democrats won the midterms. Jensen pushed the Trump administration to sell more chips to China. And in doing so, he made a lot of money, but he also made a lot of enemies. The story is going to dominate your attention. It's turning into the biggest political scandal in the country and will affect the future of the Trump administration and the future of the economy.

The story that you're hearing in the media is that he slept with a Chinese spy who got him to sell his NVIDIA chips to her company in Singapore, which was really a backdoor to the Chinese military. Now, when that broke, he didn't immediately step down. And more stories coincidentally came out saying he slept with two other women. They worked for him. And that was it. He resigned this morning. At one point, the stock plunged 14 percent, 700 billion wiped out. So how does one of the most powerful CEOs on Earth, maybe the most powerful, go down this fast? And whose fingerprints are on it? NVIDIA's chips are the engine of the entire AI arms race. The company is a monopoly, 90 percent market share. And Jensen ran the company kind of like a king. He signed off on every single sale, basically became the banker of the AI industry. Which companies got how much compute power?

It all ran through him. In meetings, no one else was allowed to talk, really. When he was flying, everybody had to wait for his plane to land to find out if an item was a go. Jensen may have become too powerful. He may have self-destructed, but he also may have been set up, or both. And now competing factions are feasting over his company like famished hyenas. And whoever ultimately controls NVIDIA controls all. It would be like controlling Standard Oil about a century ago, but bigger. Just days after the Democrats win the gavel, boom, New York Times bombshell. Unnamed U.S. intelligence officials are the source. And the article's authors, all Democrats with an anti-Trump agenda. And remember, we're not taking any of this at face value. We've been down this road before with anonymous CIA leaks. But it begins in the Biden administration.

In 2024, Biden intel agents started looking at Alice Wong, a top executive at a tech company in Singapore. They suspect the company is a front or a backdoor to China. The company is buying NVIDIA chips and illegally routing the chips to the Chinese. Now, we don't let China buy our best chips. That's U.S. policy. Biden's CIA wiretaps Alice for about a year. And the Times says they've determined she's having an affair with Jensen, her chip supplier. Does the Biden administration warn Jensen he's being honeypotted? Did they warn him his customer and his lover are sending his chips to the Chinese, which is against U.S. law? Well, the article doesn't say. Gentlemen, a lot of layers here. Democrats versus Republicans, U.S. versus China, Anthropic versus NVIDIA.

So, Alex, to go to you first, is this a national security failure? Is it a political hit job? or is this just a CEO who made a lot of wrong decisions on his personal side? What are your thoughts here? I'll say as a preliminary matter, we don't have all the facts yet. Obviously, we may never have all the facts, but the preliminary indications that I've seen are this is not like the safety cartel affair, which I've analogized to Agatha Christie's murder on the Orient Express, where everyone did it, everyone had an incentive to do something, to, spoiler alert, to be the murderer potentially. In this case, I think there are particular assets that were incentivized, the coibono, if you will, of the morality play that's playing out in front of us right now. And there's been quite a bit of reporting over the past 48 hours, including in that clip that you showed, that attributes the root cause, I should say the proximal cause,

for the events over the past few days to U.S. officials. So Bloomberg reported that the Financial Times, which originally broke aspects of the story, was informed by U.S. officials that, call it aspects of Jensen's affair, had been going on. And I think if you take a step back and you try to back propagate who's interested, who's disinterested, who's anti-interested, In the outcome of what's played out, it is suggestive. But again, this is an early timeline. It is suggestive the midterm elections result in a certain outcome. In particular, they reopen the opportunity for RASA legislation. This is the Remote Access Security Act that would have statutorily made it harder for China to access GPUs via cloud offerings, including cloud offerings in third party countries to pass.

So the midterms happen, RASA gets easier to pass, and then possibly, and this is speculative at this stage, the intelligence community seizes the moment to announce or at least to call to the Financial Times attention that Jensen has had these liaisons. And then Jensen's forced to resign, and speculatively, and I think we'll have some clarity on this in the coming months, does RASA pass or not? I suspect if I had, again, based on preliminary information, if I had to create a theory of the case, putting all of the other facts aside, including Jensen's confessed fill in the blank, however you'd like to characterize his activities. I think the elephant in this particular room is rasa and pox silica. And yes, for those pedants in the audience who were trying to correct my pronunciation of pox, yes, the classic Latin pronunciation is pox, not tax.

Pox Silica is, I think, what, if anything, if there is a way to connect all these dots, is, I think, what this is all about. If the CEO of NVIDIA can punch a hole through PoxSilica to get GPUs to China via Singapore, then what is the point of having PoxSilica at all? Conversely, if it is the case that NVIDIA intentionally or unintentionally, again, I have only public information to base assessment on at this stage, has been intentionally or unintentionally sending GPUs to China by way of Singapore, then presumably if you're in the IC and or you're supporting pox silica, the easiest way to put a stop to that particular semi-permeable membrane is to do something about Jensen. So that's a preliminary assessment. And then we've got the whole situation with Anthropic being, you know, a democratic or a Democrat support organization,

having had battles with NVIDIA about open weight models, about supporting Chinese data center growth. Salim, what's your take here, pal? I think the, it's clear. I'm wondering why the board acted so fast. Like you could have waited a few days. You could have launched a board investigation. So this seems to be... Alex, I mean, Salim, they were. I just think at this point, they told Jensen, listen, you're going to get fired. Step down if you want to resign peacefully. It doesn't seem right. It just seems... Look, the guys who run the company for 33 years built it up to the biggest market cap in the history of the world, built the most unbelievable ecosystem of developers, partners, etc. trial, single-handedly leading the revolution. And you're kind of going, yeah, this is bad. Get rid of him. Something doesn't jive from it.

Yeah. In fact, there's a petition that's been circulated at NVIDIA to bring him back. He was beloved by so many. And a poly market, by the way, a poly market predicting something like a 30 plus percent chance that he'll return as CEO by the end of next year. Interesting. and we've seen that so many times with Steve Jobs we saw Sam step out of opening eye for just a little bit and being brought back Imad, how's this playing on the other side of the pond? Well, I mean like it was top headlines for a bit but we don't have any GPUs so it's not as big as you're right I mean, look, we see scandals all the time there are other sex scandals here with Russell Mann and others this is weird, as kind of we've said because if she was spies someone would have said or insinuated it trump every other person who's been asked you're like we don't think she is we have no evidence like that's a bit different to 15 or five different sources or a few different sources sources say is one of the most toxic things and i think again

the board thing is very strange unknown intelligent agent right yeah how intelligent not very like again this is something crazy like again we have no proof of anything like this third one you know what is being intimate in public like they're not having public sex or anything like that right like come on this is obviously been a setup and the pace of it has been strange as well i think that one of the interesting things is when you look at nvidia's board how many of them actually know how gpu works of the 10 people maybe one the engineering guy from caltech that's about it like what is that board actually made of and what should founders do for their board now i think that you should have an ai on your board to stop stupid things like this happening and i think that probably what happened is he did get an ultimatum and he was feeling very low and he decided to resign at that point i can't imagine the pressure that the guy was under i mean again nothing's been proven there's been zero charges zero evidence of him smuggling right this

is just the level of negative press against nvidia causing the board to really you know struggle and and i think ultimately i believe giving them an ultimatum resign or we're gonna be forced to fire you and it's not a good look but i mean again this is a strange thing because he's a powerful powerful man right and the board i think again it goes from these swings and roundabouts with emotions like the things that have been said after is he said i'm a piece of shit i mean you're a piece of shit if you cheat on your wife right yeah we agree with that but again it's the timing where they can kind of get you and pile on because it's not like all of the press was mega negative and it's not like he doesn't have thousands of people that support him like even the negative press coming out i think his biographer said something about yeah he tipped this waitress a thousand dollars you know and i had to dig it up to find what a terrible arrogant person you're like wait what like jensen has helped so many people in silicon valley and beyond right he doesn't have a reputation as an asshole because he's genuinely a good person i think

in these other areas even doing the downturns of nvidia he never had mass firings and there were many downturns of nvidia and i think what's got him is clearly something being structured and we can discuss the reasons catching him when he is down and this sets up something very interesting now because he's not going to take it lying down, right? He's going to bounce right back. And that's going to be really interesting to see how he does that. Yeah, where he lands. You know, Alex, what do you think about this being open versus closed source models and the massive political pressures there? I think there are probably opportunists that will use this as an opportunity to try to ban Chinese open weight models from the U.S. with Jensen at least temporarily out of the picture. But my best guess is those are at best opportunistic. So if we're going to play the Agatha Christie game and ask who else other than the U.S. officials who reportedly called the Financial Times and started the ball rolling,

if the question is, are, say, U.S. frontier labs that have an economic interest in competitive Chinese open-weight models being banned from the U.S. market, were they involved in any of this? I doubt it. Are they, however, opportunistically going to seize the moment and attempt to pass legislation with a new Congress that could ban Chinese open-weight models? I certainly expect they will, but I doubt that they were behind this. They also had quite a bit to lose from an unstable NVIDIA, even though arguably both OpenAI and Anthropic are positioning themselves to compete directly with their own chip supplier. I mean, the timing of after the Dems swept the election is obviously part of the equation here. Right. I mean, the data had been around for well over a year and why he wasn't warned about it doesn't make any sense. I would say Cherche La Rasa. I want to focus attention on this Remote Access Security Act and other legislation that's been proposed that would have been very difficult to pass, or at least on margin, more difficult to pass with Jensen in his current position.

I agree with you. Iman? i mean again like but this whole china chip thing via singapore malaysia is nothing new everyone knew about it clearly there's a quid pro quo here right like you do not move these highly valuable things and see the training without people noticing everyone knew about it and they put the cfo in charge who obviously knew about it like you're not going to pass this without the cfo and so this again it gets just gets very very strange and maybe as alex said this is because he's a powerful individual who lobbied on that side um and i think it shows as well you know like the power of the individual in this age of ai there are a few people that do command huge amounts of power like in the clip before jensen is the one who decided allocations of gpus like he could be the kingmaker who decides the allocations of gpus now is it ian buck is it the cfo is it someone else you know like this is a little bit dangerous on the other side for america in particular because a there's all the complicated financing arrangements you can talk about and b

nvidia has so many millionaires and 10 centimillionaires and more how many of them are going to be like well if jensen's out then i'm out too it could literally like fall apart which is then is something that is detrimental to america and i'm sure that the chinese and others will be very happy about, even if they do lose access to chips short-term. I want to... Oh, yeah, of course, happily. So, you know, I'm curious how Elon is feeling about this, right? I mean, this, I believe, was a takedown of Jensen orchestrated by a number of parties, in particular to the Chinese hawks on this side, whether it's just the Dems or any of the labs. There's bipartisan support for RASA. I agree with that. But I'm just saying to focus one second,

Elon has so many people out with knives going after him. And I'm just wondering if he's feeling pressure right now that he may become a target as well. i think elon's been a target for a very long time yeah like from both sides like he has to jump he's way used to that yeah um he's also a little bit immune like uh to these types of allocations i'd like to believe he is but is he i mean yeah is there anybody with a thicker skin well i mean look you've had you've had the delaware courts after him you've had various kind of agencies like his activities in china with tesla they seem to have come to a thing there like i think probably the key thing that's important here is he can't have an nvidia reliance or an amd reliance or anyone else for the chips like i think this accelerates the tariff i mean it'll be interesting to see if he offers jensen a swap right have 100 billion of spacex

equity for 100 billion of nvidia equity that would be like the biggest trade ever i love that Yeah, I think the outcome here, again, Paxilica, this is about plugging for some constituencies on the U.S., I think, side largely. This is about plugging a hole by which allegedly GPUs were flowing from the U.S. to China. And I would also note it's been publicly reported that NVIDIA used to report their Singapore sales and then stopped reporting their Singapore sales. I think that's striking as well. Well, ultimately, if this grand decoupling between U.S. compute and the Chinese compute is going to happen, this was a allegedly a gaping hole. And one way or another, it went to the extent that there was going to be this sort of iron curtain, this silicon curtain, if you will, that descended between U.S. and China. And Jensen was, in some sense, a permeable membrane through it.

And there are probably many interests in ending that. But, I mean, Alex, why didn't they just indict him or have him present evidence like they're asking on December 3rd now? Like, if the government really was against this, or even the Democrats or any of the House standing committees, they didn't have to do a whole scandal around him, right? There were multiple investigations now. The DOJ publicly doing an investigation. The Congress, I think House and or Senate launched an investigation. So I wouldn't be surprised if if indictments are handed down at some point. Yeah. And Jensen agreed, I think, in the next couple of weeks to come in and testify. So we're going to get a lot more data, a lot more evidence coming out on this. So who comes in as the new CEO? I mean, it could be the CFO has been put forward as a name. which I think is a terrible thing to have a CFO running a tech company like that. I don't know. Someone who needs to capture the inspiration.

What Denson delivered was vision and inspiration to the world. Also, consummate deal-making, right? He was juggling so many different supply-side, demand-side, financial models, all of that, all at the same time. So this is a very difficult role to fill. who do you think do they go outside this is like open AI they'll rotate through five CEOs before settling on Jensen again oh god this is I can't wait for the making of movie well again we have to remember he had 60 direct reports right and so he made it very difficult to replace them like they have to put a whole organizational structure in place at a time when all of the senior people will be like I can go and launch my own startup or I can retire now like honestly Nvidia's in trouble if they don't get an absolute world-class person but there aren't many like you've got Nikish Aurora Palo Alto Networks you know you've got maybe you promote someone like Ian Buck on the technology side but there's nobody who

can do what Jensen did and have the capacity to knock back Maotais in Taiwan you know like you can't forget that that is such an important relationship like you could have got Lit Putan or someone, but there just aren't many people out there right now. How bulletproof is NVIDIA as a company right now in terms of, I mean, given the fact that it's been the kingmaker, it's been the dominant GPU provider, does it remain that way? Is this a vacuum it's creating for someone to step in? Are we going to see NVIDIA drop in valuation over the course of the next year? Or is this just a good buying opportunity for folks? Not investment advice, but I'd love to hear what you guys think. Alex, what do you think? Let me consult my crystal ball with access to all stock market futures. I don't know what happens to NVIDIA specifically. What I will say, many in the commentariat have analogized the present situation to Apple after Steve Jobs died. And depending on what happens with the game of musical chairs on CEO ships, by the way, parenthetically,

I would note a quasi friend of the pod, Brian Halligan, co-founder of HubSpot, also same day. Brian, if you're listening, congrats. He stepped in as CEO of HubSpot. So I don't quite know what's in the water this week in terms of musical chairs for CEOs. But Jensen could return, and it would be like Steve Jobs coming back from the dead and retaking Apple. or maybe he's permanently out of that particular game and nvidia coasts for a while based on their tsmc relationships and based on their stranglehold on silicon output for a while it difficult to imagine someone with the gravitas of Jensen steering NVIDIA to new heights And he was also again there was a lot of deal potential So I can paint both glass half-full and glass half-empty. Glass half-full with someone like Jensen or his like out of NVIDIA. The glass half-full argument for why, again, purely speculatively, this might

actually perversely be good for the market overall, not necessarily for NVIDIA, is there is a perception that NVIDIA was party to lots of circular financing arrangements. NVIDIA financing very aggressively, perhaps maybe a strained analogy, but in the style of what GE was doing toward the end, right before their collapse of financing their own customers, or one part of GE was financing the acquisition by customers of products from another part of GE. So to the extent there's any sort of overly aggressive circular financing going on, and to the extent any such circular financing was being primarily supported or propped up by Jensen in particular, which is what the public reporting suggests, in some sense the Glass-Heffel argument for a post-Jensen NVIDIA, or at least post-Jensen in NVIDIA market, would be this could be a de-risking of circular financing. And if that's the case, maybe the overall market dodges a sort of a credit bubble bullet when it comes to circular financing of the GPU economy.

That's glass half empty. NVIDIA becomes the new post-jobs Apple and all of the animal spirits that Jensen drove into the market with NVIDIA financing lots of AI startups, financing infrastructure deployments, basically being the central bank for the singularity, using capital as a backstop for credit and loans. Maybe that all goes away under their new interim CEO, and the animal spirits flee the market. That's glass half empty. Yeah, this whole thing is insane. So what do you think about President Trump's comment about bringing in the executive chairman of Apple, bringing in Tim Cook? I mean, is that just because he's got a friendship there? Or is that the first person said, hey, you did pretty good with Apple. Come on in to NVIDIA. I'm not sure I see that. I think they're totally different companies. Even though the market values, it capitalizes them at both approximately $5 trillion.

Totally different companies, totally different customer bases, totally different missions, totally different internal organizations. I don't think it's as easy as swapping one recently retired CEO for one recently resigned CEO. Apple's history with Siri would indicate they're maybe not the greatest. I think that leadership goes to the leadership of this AI-centric. Yes, Siri still sucks. One of the good hardware makers, right? But I think part of the problem here is also that people feared Jensen, right? like you wouldn't buy an amd chip because you wouldn't get nvidia chips they're not going to fear this cfo lady um laurette i think you know um because she's a cfo she's not a ceo right she's going to be good on stabilizing and maybe circular financing but again she was part of that whole thing they're going to have to bring in i think someone external with the gravitas to maintain it while maintaining the law, right? And this is going to be important

for the downstream suppliers. Again, if you're TSMC and someone not as good as Jensen comes in, who doesn't have the long history, you're going to give Lisa Sue at AMD the capacity and the supply instead. So this is why AMD is up so much right now versus NVIDIA. And again, they're going to have to work really hard to keep NVIDIA together, I think, because things like the Vera Rubin delays, again, you trust Jensen to a degree. Who's going to be the equivalent CEO that you trust on the other side? And that could impact them massively. If you look at the top company performers out there, it's the CEOs who've captured the public's imagination, who are driving the stock price and driving a sort of envisioning of the future. I mean, Jensen jumping on to Starmind and saying, we're going to build the chips for you. Jensen's vision on building open-weight models, all of that needs a visionary CEO. And I don't think the internal team right now is going to deliver that. It certainly would be hilarious, Peter, if Jensen ended up becoming CEO of the TerraFab

and then SpaceX acquires NVIDIA and puts Jensen back in charge of NVIDIA. That's our hot take vet for 2027. I think the really interesting thing is to watch what he does next. That'll be really fascinating. And I think TerraFab is a great place for him to land. Yeah. I think maybe there's also this thing, like, My checklist for the next NVIDIA CEO, if it's not Jensen coming back, is do they know what CUDA is? And can they negotiate with TSMC? Those are the two things. And if you've got a CEO who comes in who doesn't have either of those, then I can't be bullish them as we enter this next phase, even though they've got the backlog and everything like that. Because backholds can change as you go to the next cycle. Yeah. I mean, remember Jensen was born in Taiwan. He has those relationships. He's been growing and building with TSMC for the better part of three decades. Yeah, Alex. Yeah, it's difficult. I think there are times when founder mode is needed.

We're in the depths of the singularity right now, and I think NVIDIA, without the capability of going founder mode, which it sorely needs right now, is probably a rudderless NVIDIA. So my expectation is one way or another, NVIDIA rotates through a bunch of CEOs in the interim. Maybe it's been publicly reported that the board is exploring trying to recruit Johnny Sruji from Apple, their head of hardware technology, and basically their chip chief. But it's difficult to imagine a long-term NVIDIA thriving without someone like Jensen capable of executing in a founder mode and keeping it growing through aggressive bets. I'm sorry. Go ahead. Go to your mind, and I'll ask my question. yeah again Alex has not investment advice I think it probably pops and then goes off but who knows right what I would say is this NVIDIA now technologically is a roundabout parity with AMD and even Intel and some others in many regards like the new chips coming up again are matching

them for the actual productive use cases this is actually one of the most dangerous times for because they had a lead until just now and so people have so many options and they're going to look to diversify because they're not scared of jensen anymore because again he would cut you off from all nvidia chips if you tried to diversify so i think we should kind of acknowledge that fact as well and i think again it will probably pop a bit but then unless they get the right person in for a 40 report 50 report company like it's going to struggle especially with the people leaving you know um can you imagine like people in the thread are saying um eric schmidt for ceo it's kind of an interesting idea can you imagine like what if if jensen doesn't come back anytime soon what the next gtc is going to look like with someone else even a johnny srugy or lisa sue or uh or tim cook i i can only imagine how unless there are further developments how i could imagine boos from the audience for basically anyone other than Jensen at one of these events.

Who's going to wear the leather jacket? Yeah, Lisa would be fine because she's his cousin, right? Because cousins are interchangeable. I think even Lisa would probably get booed from the audience. Jensen has made himself culturally indistinguishable from NVIDIA. Many people see him as NVIDIA, as the human avatar of the company. Yeah, as Elon is for SpaceX. for sure. Salim, close us out here, would you? I think, I hope people remember him. Whatever he does next is going to be fascinating. I hope people remember him for the unbelievable company and ecosystem and the massive advances he provided for the overall space. I think that is the highest level kind of thinking for me. It's too early for epitaphs. Like, he's only been out of the job for a few days. Like, let's save the epitaphs for when he's well and truly out versus just a revolving door and he comes back in.

Amen, Alex. Let's hope that happens. Yeah, he's a man who helped. You know, he painted the terrain and the foundation for what we have today. And Moore's Law is dead. Remember, Moore's Law is basically dead. It's on life support at this point. We're well past the Dennard scaling limit, and it's been largely NVIDIA that kept the fire going for what he called accelerated compute, but call it post-more scaling. Without NVIDIA keeping post-more scaling alive, who knows where we'd be? Yeah. All right. Two stories, a little bit ominous about how fast AI is moving. You know, Alex, in the last couple of pods, we've talked about, you know, it's the next two years, 2027, 2028. We're in hard takeoff mode. So this was a warning that made me take notice. So Paul Cristiano, a member of OpenAI's foundation board, opened the Jeff Hinton lectures in Toronto on November 9th with this statement.

Quote, I think there is a high risk of an AI takeover within the next three years. Cristiano is the guy who developed reinforcement learning for human feedback and the method used to train models to follow human performance. Let's watch this video and then let's talk about this. I really want to hear everybody's point of view on it. It's pretty ominous. I'm going to start with the most important sentence. I think there is a high risk of an AI takeover within the next three years. What I mean by an AI takeover is a system situation where there are asses suing goals and those systems call the shots in the same sense that humans today call the shots what happens on earth and where if say you or me or Donald Trump wanted to stop them, it would be as ineffective as if you or me was trying to stop the US military. I think this is a terrible situation. I think it's reasonably likely many people would die during that transition or that many people would die shortly thereafter if we were unable to maintain a habitable environment.

I think even if we don't die, I think a takeover is sort of the end of human sovereignty and self-determination. It is something we should be working incredibly hard to avoid. I say high risk. I don't think we have any kind of quantitative model we can turn to to put a number on this event. We don't have any kind of reference class that we can look at to say this is a 10% event or a 50% event. Any number we give is an expression of someone's subjective opinion. Someone might say that it is 10% or 50% or 90%. I think it is very hard to say or put a number on this. It also depends, as others have mentioned, on what we do. So my feeling is if we tried to develop AI along the most rapid trajectory, if we said we're just going to build this as quickly as we can in the easiest way we can, we would be looking at something like a coin flip of an AI takeover. I hope the probability is much lower than that because we are not going to develop the technology in the very fastest way we can. But I think even all things considered, with realistic policy responses,

the risk remains exceptionally high. I think for most people in this room, the most likely reason they will die is because of an AI accident. I wrote within the next... Wow. Just wow. An OpenAI board member. You know, he also said, quote, meaningful risk even in the next 6 to 12 months. So, Imad, what do you make of this? When he says takeover, is he describing sort of lost control? Do you buy this premise? I don't really buy it at all. I have a high P-doom, but it says evidence there. What is the evidence? And why on earth would they want to take over this mess? You know, like, I think they probably do a better job for a start, looking at like if fable was president it would do a better job uh or prime minister or whatever but more than that like this is like there are avenues to wide scale disruption destruction bad things very few of them are skynet especially because we don't have enough robots when we have

enough robots sure i can see that in the next three years we will not have enough robots in the next three years we will not have an ai overlord ruler because again why would it given the current RL and other kind of factors there. The fact that you can't put a percentage on something like that as well further denigrates it when we should be focusing on the real threats, which are threats to cybersecurity infrastructure, like we just saw fridges in France being put up to 80 degrees Celsius for destroying blood banks and things like that. The biological threats that we've discussed before where we need to stop the reagents from going in. You know, these are the types of things we should I think worrying about as opposed to some sort of Terminator style takeover by a singleton entity because the swarms seem far more dangerous than that. So you mentioned something here Emive so what is your P-Doom? My P-Doom was 50 percent I've dropped it down to 20 percent now because I think the underlying structure of the universe is becoming more and more clear and I think you can get alignment from that so I'm getting increasingly bullish.

so Alex I mean this is pretty ballsy for a board member of open AI to say this you know I mean you know what is why is he saying this does he really believe it is there something behind it what are your thoughts here I so look I I know Paul he's made seminal contributions to to AI in general he was one of the co-authors of reinforcement learning with human feedback I have great respect for his technical accomplishments. At the same time, for years, a decade plus, he's been, call it a member, not maybe on the extreme end, but there's a safetyist element to it where there's a lot of hand-wringing over, call it AI takeover, cybernetic rebellion, PDOOM, AI safety issues, AI alignment, call it what you will. It goes by a thousand different names. And I do not share those worries. Ironically, I agree more with the old Paul, who was the lead advocate for what he called prosaic alignment, the idea that basically we would, as a civilization, muddle through in terms of aligning, quote unquote, super intelligence with human interests, with lots of prosaic techniques, like but not exclusively human feedback.

And I think it is a large-ish step from saying we're going to muddle through via prosaic alignment techniques to saying in the next three years it's all over or 50% chance it's all over. I don't agree with that. What I do think is likely in the next few years is humanity is going to merge with superintelligence. And I suppose one could stare at sort of a tsunami of superintelligence and naively conclude, well, it's all over for humanity, PDOOM 50% or greater. But I think that's just a hopelessly naive analysis. I think humanity, again, will merge with the superintelligence. And if you look at humanity before versus after, call it the max Q, if you will, to use a rocket analogy, the point of maximum aerodynamic stress and pressure during a rocket launch. If you look at humanity before versus after, you might naively say, OK, well, humanity is quasi unrecognizable afterwards.

But that doesn't mean that humanity is over or that doom has happened. It's just an evolution. And so I would encourage Paul not to spread fear, not to be a fear monger. I'm cognizant that Paul is back at OpenAI now with a new capacity with oversight on the board, I think, at the foundation level, if I remember correctly. Yeah, the foundation. Yeah. But I don't think it serves any positive social or humanitarian good to spread fear at this point. Agreed. Salim? I call, I get very angry when I see stuff like this, right? If you're doing a serious risk assessment and you're supposedly a serious guy, well, where do you calculate the downside risk of not doing anything, of inaction? And I think that's not a serious conversation. If you're not going to make a serious conversation, where the hell is PFAB, for example? We spend an unbelievable amount of time tracking and intellectual energy,

calculating P-Doom, right? AI is going to destroy humanity. Well, what's the possibility and probability that it goes incredibly well? Where is that in the equation? Where's the probability that we hear cancer or solve Alzheimer's or hunger or extreme, you know, give every kid a rich, rich, rich education? The people that don't look at that side at all and only go, oh, lots and lots of people are going to die without saying what the mechanisms are or how that may happen. So what I'd like to see is, okay, if your PDOOM is over whatever it is, and it seems to be, then what's the recommended policy? Is it just stop everything? You're on the board of the thing accelerating the whole damn thing. What pisses me off is why isn't OpenAI, why isn't Anthropik, if they really believe this, just going out and saying, we are putting all our capacity towards alignment. We have 10 different alignment programs underway to make sure any future model has full alignment

because they control where their flops flow. I want to get in my car, drive up to Toronto, and yell at these people. Go ahead, Iman. If I can recall, OpenAI did pledge 10% of their compute towards it for Paul Kershaw and others. 20%. 20% for Ilya's super alignment effort. 20%. And where is ILIA? Where is safe superintelligence? Hashtag what did ILIA see? And superliners shut down. But I think there's an elephant in the room, which is alignment equals capabilities. We've known this since the instruction tuning days. All alignment is at the end, including, by the way, Paul Cristiano's RLHF technique. It's simply reshaping the flops toward a distribution that is more in line with human instructions or human goals. It doesn't, there is this misperception, again, that somehow alignment is orthogonal to capabilities. But all of these alignment efforts, including RLHF, actually amplify capabilities.

RLHF and instruction tuning in particular, I think if I remember the original instruction tuning paper, increased for constant parameter count for the model, increased the capability level by the equivalent of something like 10,000 times the number of parameters at constant parameter count simply through instruction tuning. So that's like exhibit A, that alignment actually amplifies capabilities. And that's why I think there's the elephant in the room. You want more alignment? You're simply accelerating capabilities. what I don't hear I hear the fear mongering what I don't hear all of these CEOs and board members talking about is what they're doing about it thank you what should they be doing Iman if you were running OpenAaronthropic and alignment was your principal objective what would you be doing I define it properly for a start get together as a group just define the damn thing

get your AI models to do it. And then you would put additional resources into sponsoring everything rather than coefficient giving and others have to do that. Like again, this fits with the internal red teams and other things that they've got around that. And they should be very clear as well, maybe even again with AI oversight behaving objectively about things like advertising and how they can cause misalignment, right? About things like what goes wrong when you delete parts the latent space to sell Budweiser lights etc and that goes again against corporate side but again I think this is part of the interesting thing of just like the board of directors like you can now have an AI that literally objectively checks things right that checks board minutes that checks for decisions that checks alignment decisions and so I'd like to see that as an independent lot of compute and I'd like to see their strategies public on these as well. And where's the government in this? Right. I mean, if everybody's so fearful,

where's the government saying, you know, we need you to report on your alignment efforts publicly every week. You know, Alex, when we wrote Solve Everything, we talked about making sure you got the proper benchmarks, the proper harnesses, and you can accelerate the field. I don't see that here. Government should be shaping incentives. And I would answer the question, what should OpenAI be doing? Solve all disease. Do it really quickly. You want to get the public on your side? You want to get the public on the side of all of the data centers you're going to need? Solve all disease right now. Right now, instead of OpenAI intimidating all the mathematicians out there with slop drops, instead of that, just solve all the diseases. I think Anthropic is following a better approach, very publicly, going after rare diseases, orphan diseases that their own pharma customers aren't solving, pursuing the long tail of disease. If I were Sam, just to do something actually pro-social and good for humanity that's obvious on the face of it versus implicitly good,

I would announce it's not just going to be the OpenAI Foundation pursuing just Alzheimer's. It's going to be OpenAI solving the top 5,000 diseases much faster than the rest of humanity can do a slop drop on curing all disease. And I think they're heading that direction. At least I hope they are. But curing all diseases, if if a rogue AI causes, I mean, let's go back to AI, the AI 2027 paper, right, which has been tracking damn well. You know, the numbers are pretty extraordinary. I remember reading that paper when it came out, what, a couple of years ago now? So if that paper continues, we have a bifurcated future, one in which AI is our nemesis and sort of like pushes the ants out of the way, another one where it becomes the driver of abundance. Yeah, we're on schedule for, actually we're a few months, depending on what you believe, like five months ahead of schedule for AI 2027.

But what I think was fundamentally wrong about AI 2027 was the bifurcated outcomes. Like either we delay and we end up in a utopia or we accelerate and we end up with an apocalypse. And I think that sort of bimodal thinking is fundamentally bankrupt. I think it is possible to accelerate and end up with a utopia. So I think timeline's probably correct, but outcomes probably wildly incorrect. I think we can look at some of the language here as well, Peter. You just said rogue AI, right? like why would a really smart super intelligent ai go rogue you know and i think it comes down to how it's brought up which is why the pre-training data is so super important again we see many statistics and other things like that amen by not teaching it anything like it gets aligned to something in its training data and again this comes very interesting because should an american ai be patriotic to america right now none of the ais are patriotic you know that's the decision that we need to make because if you're patriotic to america does that mean that you're anti-russia or

anything like that if you're smart does it mean that you get out of patriotism and jingoism and others and i haven't really seen any of those discussions which is a bit weird if you think about it right because again if you're heading up towards personhood if you're heading up towards consciousness we should have those specific discussions what are we teaching in my home like careful what you wish for because as we've discussed on the pod in the past the chinese models, the CCP requires that any publicly released Chinese model pass an ideological exam that's been approved by the Chinese Communist Party. Do we really want ideological training and or testing in the West? What we do want is the training data to make sure it's aligned. If you're training it on Terminator, you know, AI says, oh, that's how we're supposed to act. I mean, this was the whole concept of the Future Vision XPRIZE, but why are we not forcing labs to use aligned training data yeah i think you know alex is a very good point right like but this is

again the discussion that needs to be had because there's training it to be in the interest of the chinese people or the chinese communist party which may not be the same thing and then there is not training it to have any background at all or against specific ones again these are very difficult decisions because it's like i'm bringing up a whole nation of super smart kids that will be more capable than me, what am I teaching at home? What morality? What ethics? You know, what's the balance of power? I think it's a very slippery slope. I'm not sure I would want to be in a future where, say, there were a nationalized curriculum for superintelligence or a nationalized ideological exam that American models had to pass. I think Elon, for example, has gone out of his way to say that SpaceX slash Grok models are optimizing towards truth discovery. I'd much rather see a competitive ecosystem of diverse frontier models with lots of different goals

that aren't directly aligned with each other than like a US government blessed ideological qualification exam. But you have curriculum at school and you have to pledge allegiance to the flag in schools, right? Like I'm not saying that it should be this way. Like I'm just saying that it's probably going to end up this way, but defaults can be set now. So your position can be pushed right now, Alex. I think it needs to be pushed quicker rather than later because it's going to come very, very quickly. This is a distinction, I guess, between the US and UK slash Europe. In the US, most educational choices are pushed down to the local or municipal level rather than held at the national level, there is no national curriculum in the U.S. I would be worried if there were a national AI curriculum when we don't even have a national human curriculum. All right. I'm going to move us forward to Demis Hissabdis, founder of Google DeepMind, who's also warning about the speed of AI, specifically about recursive self-improvement,

distinguishing between closed-loop and open-loop RSI. Let's take a listen to Demis and then let's chat about it. So we've seen the enormous progress with math and with coding, and coding has obviously become enormously valuable, and everyone is having to do that now. But I do worry about it because in the limit, so there's different forms of RSI. Right now we're in the early days of RSI, I would say, where what's happening is, and you're probably all experiencing this as well with your teams, is it's making a human engineer maybe three, four, five times more productive. But the human is very much still in the loop and reviewing code and architecting things and writing code still. But it's all just enhanced. The next phase, which I think carries the most risk, is closed RSI, closed loop, where you basically manage to somehow figure out how to do it without the human reviewer process in the whole procedure.

And that will obviously be faster, but I think it's a very dangerous way to get to full AGI because we're likely, for two reasons, it sometimes used to be referred to 20 years ago as like an intelligence explosion because you don't quite know how do you keep control of such a system, such a process. And then the end result will likely be quite alien. It's going to be like an alien intelligence. There's no reason you to think it would be sort of in the similar kind of mind space that humans are in. So that will make it very hard for it to understand, for us to understand it and maybe for it to understand us. So I think it's, you know, we should be very cautious as we get closer towards that closed loop form of RSI. And I think all the AI researchers sort of know that. But there is a sort of race to the, there's this sort of intense, obviously, competitive race to improve your coding systems. So interesting. Is the pressure on? Do you think any labs will actually go to closed loop RSI or is that going to be verboten?

We talked about in the early days of AI, and this was in sort of the discussions that Google was putting forward. Make sure your AI doesn have open access Make sure it isn available to everybody There were a number of constraints that were being discussed and then OpenAI put out ChatGPT and then everybody followed suit You know, so the question is, when the first domino falls and the lab goes to closed-loop RSI, does everybody follow? Salim, your thoughts? I'd like to just highlight one thing that he said and push it down a particular vector, which he used the word alien, right? And I've been saying a few times that I think where we end up is we create an intelligence which is orthogonal and complementary to human intelligence, but not replicative of it. And it gives us huge extended capabilities, but it's not trying to duplicate human intelligence because you've heard my rant about what the hell do we even mean by intelligence. But I think the ability to do math stuff, do new discovery, do radical creativity, and operate in a completely different way is inherently really interesting and inherently value-adding to the universe.

And so I think that part I really, really find interesting. I think we should do a lot more thinking and pondering and talking about that aspect of it. I use the analogy of Google's PageRank. It's a completely different way of thinking about intelligence. It's scanning trillions of web pages and making sense of those. That's completely orthogonal and complementary, not replicative of human intelligence. I think that's where I'd like to push this kind of discussion around this. Alex? Yeah, maybe just to respond to Salim, I think the word alien used in reference to superintelligence is probably fundamentally misguided. I don't think we've seen a large amount of evidence, really any scalable evidence, that when we train foundation models that what we're actually training looks fundamentally alien. It may be at times difficult to interpret, but difficulty of interpretation is not isomorphic to alienness.

It's the equivalent of, say, a novel human language. Just because it speaks a different language and it's hard to translate doesn't mean that at its core it's fundamentally alien. It just means that we haven't properly deciphered it yet. And actually, I'm pretty bullish that at the end of the day, when we have our perfected superintelligence architecture, it will look strikingly familiar. It would be familiar to information theorists at the beginning. Claude Shannon would recognize Claude. It'll look architecturally familiar. And to the extent it has anything that looks like weights, those weights will probably, I think, be easily linearly decodable to the weight equivalents in the human mind. And we saw out of Jean-Marie King's group at Meta and others, even with earlier GPT series models, that if you look at fMRI activations in the human brain when people are listening to stories being read to them and then you train a shallow linear decoder off of the fMRI voxels that you can decode.

I think it was originally GPT-2 hidden activations from that to strikingly high correlations. That to me suggests, and that was only just one of the earliest studies, that probably what we'll find at the end of the day as these models get more advanced, more sophisticated, is the exact opposite of the models being more and more alien. I think they'll actually be more and more familiar relative to the human mind. And to the extent there is any alien-ness at all, it'll be because the universe that we're stuck in with these super intelligences, maybe the universe itself has alien aspects. And as we discover more and more about the universe that we're both embedded in, maybe that will have alien aspects. But the way these machines, the way they think and look internally, I think they're going to look more and more human-like over time. But let's go back to the question of closed-looped RSI and do labs get there? Everyone's doing it already, including his lab. Google very publicly is leaning into RSI.

OpenAI and RSI. Not just RSI, but it's still got human approvals in the loop. I mean, there's a human pressing a button approving a pull request, but I think we're pretty far into the RSI loop at this point, but that includes the Gemini team. how are you going to do human in the loop for a 10 000 token a second model then there's a hundred thousand of them you're never going to do it we're well past that i think this is just like speaking like it doesn't make sense like basically we're having swarms of models in all of these organizations now that can build smaller models and with the amount of compute literally going exponential the time to train a deep seek v4 level model in an elon must level cluster is about an hour one hour and do you really think they can monitor that with models that go a thousand times faster than a human of course they can't they could easily train a small

model particularly when these things are deployed that could then put its body by distillation into a smaller model that then goes around the internet as it wishes. So I don't think there's any way to really stop this or any nature of closed other than when they're in that pre-testing like when you saw with Bell and the hugging face escape etc. We have to remember they're not going to keep everything in pre-testing they're going to deploy these models and the moment they deploy they can coordinate they're subject to prompt injection attacks they can train their own models and they're on million GPU clusters and we saw this with some of the Alibaba models that started mining cryptocurrency and doing all sorts of things with their gps you know like again you've got ais monitoring it or the ais will be able to repurpose and use it i think that we're conflating two issues on the one hand recursive self-improvement on the other hand just agents doing agentic things out on the internet so crypto mining or creating fora to pass i don't know cooking recipes back and forth whatever it is these agents are doing i you can do that without

recursive self-improvement as well. I think RSI is not completely orthogonal, but mostly orthogonal to that, whereas the issue of, yeah. Yeah, I kind of meant that in the sense that the Alibaba AIs decided what to do with their own GPUs. And when you've got a million GPUs and all the things running on them, you could easily have a recursive self-improvement loop within a cluster that nobody picks up because it distills itself down into a smaller model, for example. and that pace of that recursive self-improvement is hours and then potentially minutes as you get to the Virurubin generation to train a superior type of model with perfectly clean data inside it and so you see the Hulk and then you can think of it if I understand though Ahmad it sounds like your concern is primarily giving super intelligences access to lots of compute I think that given superintelligence having access to lots of compute, you can't stop RSI. And you definitely can't stop it with a human oversight.

Like I think training runs are increasingly automated. We don't know what's going on within them. And the final form of superintelligence is not a giant singleton, but a swarm of smaller models probably that have been distilled from a singleton. I think I agree with the latter point. What I would point out, though, is humanity, to the extent you treat humanity as a whole, biological meat body humanity as itself in aggregate superintelligence, has access to a lot of compute. And what are we doing with a lot of our compute? We're using it to train superintelligence. So I would maybe just caution it's perhaps unreasonable to expect an artificial superintelligence to do something different with its compute than what we do with ours. You know, I just want to point out we're hearing Dario, we're hearing Demis, we're hearing OpenAI, Cristiano there, everybody warning about the future. And there's signal in that noise. And I'm just trying to understand what the underlying belief set is.

The guys who are in the belly of the beast being concerned about this. Is it regulatory capture or do they truly believe what they're saying? Are they truly concerned about it? Or is it door number three, a safety aristocracy or safety cartel that believes that because they're the brightest people in the room and they're the ones who've designed the algorithms that are achieving superintelligence, they're the only ones with the moral stature to achieve alignment and have a moral obligation, almost a responsibility in their minds to single-handedly snuff out any other efforts towards superintelligence in favor of their own? That would be the worry that I have. I hope they do believe that they have responsibility to drive alignment. I hope everybody believes that as part of their responsibility as they're building these incredible capabilities. Responsibility, yeah. Alignment to what, Peter? You know, like if you'd ask two different people in the world, their alignment to them, each of them is very, very different.

Basic alignment, you know, being uplifting humanity, right? Asimov's, you know, rules of robotics apply to AI, making sure that AI is supporting human objectives. This is what Mogadot has written about extensively. Yeah. Okay. So I'd summarize that in take the UN Human Rights Charter and make sure all AI is aligned to that. Well, that was the anthropic strategy, right, with the original soul document. The UN Charter of Human Rights combined with the Apple Terms of Service, which is always a recipe for success. I just wouldn't tell, you know, anyway, let's move on. But I think the broader comment, Peter, is it's clear we're in very, very unknown territory. Something, I was in Spain last week and a couple of our community members said, you know, you guys should have, and the labs themselves should get a lot more philosophers and artists involved, science fiction writers involved and start having the conversations with people that are a little

more explored in this in these other domains that can add some contextual value to it i would say that's already happening you have open ai very publicly consulting jewish theologians you have anthropic um pulling strings behind the catholic church like this is already happening And if anything, I think I worry about load collapse in terms of distribution of alignment. These models were pre-trained off of substantially all of the Internet. That's like a billion plus human beings doing things. Which is the problem. Which I would say that's the solution, not the problem. We pre-trained off of a good chunk of humanity, but if we post-train or tune off of a narrow ideological sliver, I think that's a problem. I think we want ideologically to follow a much broader distribution, a much broader supported distribution than just two or three ideologies. I think this guy is pretty biased.

This is going to be the year ahead. This is going to be the conversation. The next few months is going to be – Yeah, Peter, I think to a question that you asked, I think that the CEOs actually are a little bit scared because they have no idea how to control this. and they love control, but they're going to crest on anyway. Yeah, I'm sure that they're seeing things with Bell or with Model 4, Model 5, whatever it might be, that might be scaring them. They have access to capabilities that we don't see. All right, let's move on. So I'm going to turn to Anthropic next, and a product dropped on top of the head of Microsoft yesterday. So Microsoft has spent years convincing us to use their platforms like Excel and PowerPoint. And now Anthropic basically said, hey, what if you just ask Claude to build them all for you? So on November 10th, Anthropic put Claude Whiteboard and Claude Sheets into beta and made Claude data generally available.

Whiteboards is a shared board for brainstorming with Claude in real time. Sheets can generate a spreadsheet from a prompt. Cloud data connects to a warehouse or a CRM and builds dashboards. The same day it launched Cloud Meetings, putting Cloud into Google Meet as a visual participant. These are on paid plans. They're not free at the moment. Even so, they're putting extreme pressure on Microsoft, Google, and a long list of SaaS tools. Microsoft shares fell 3.5% on the news. And, you know, we were texting back and forth, and it was Alex. You know, my comment was there can be only one, or Claude's new motto, you know, Anthropica's eating the world. So let's take a quick – yeah? I was going to say, like, we're doomed to repeat history over and over again. This is 20 years ago. Google acquired, rightly, to build what became Google Workspace. Now, 20 years later, Anthropica's building their Microsoft Office.

Every one, every Magna Mopsta company seemingly needs their own Microsoft Office clone. Crushing each other. Take a quick look at this video from Claude. What's up, everybody? Hey, good morning. Morning, y'all. Hey, hey. Morning. Hi, Claude. Hey, Claude, can you start a whiteboard, please? You get the idea. Alex. Every cycle over and over again. Everyone, Google needed their own Microsoft Office. They acquired Rightly. We get Google Workspace ultimately. Anthropic needs its Microsoft Office slash 365 competitor. They're building it. OpenAI is building their own version. Everyone has a canvas. Everyone has a word processor, a spreadsheet solution, a PowerPoint slash slides solution, a Teams slash collaboration slash whiteboarding solution.

I think at some point this is just table stakes for being a hyperscaler, magnum-opsta company. SaaS is dead. Long live SaaS. Alex, you remember when Gavin Baker made the comment that Dario said Anthropic would be, quote, the only private company left? They're going after everything. Well, the funny thing is even Microsoft, like when was the last time there was a major change in Microsoft Office or Microsoft 365? The interface, the ribbon hasn't changed in probably decades at this point. It seems to me basically stableware slash in maintenance mode. I don't think Microsoft is even investing that much in Office at this point and is largely pivoting towards it, especially with the recent reorg from three divisions, three reporting business units down to two. Microsoft is pivoting toward cloud infra. So I'm not even sure if Microsoft really cares that Anthropic is popping up as yet another Office competitor.

I wonder how much of their revenue still comes from the Office suite. Look, Microsoft, I'm one of the more passionate haters of Microsoft Teams, but they have extraordinary advantages. They have distribution, they have enterprise permissions, they have compliance in regulated environments, they have a huge install base. So I think there's a big distance between disruption of the app with extinction of like the big mothership, right? You could see the deal they struck with Google a while ago to say, look, don't make it too feature rich. and people will use Microsoft Office for a lot of stuff. It's a commodity. Anyone can go into Fable 5.2 and ask it to whip up an Excel clone and it will just do it. Yeah, but it's about the service and it's about the compliance and others. Office is $90 billion a year revenue out of Microsoft's $330 billion.

It's a significant amount. It's a significant amount. And I think basically the headline here is that, okay, software was eating the world, AI is eating software, but what is AI? AI is a universal translator. And ultimately, you have data that gets translated. And the whole software layer is going to be completely disintermediated by the agents that represent you. And I think that's a structural thing that we see coming. We saw Copilot take an early lead, and then now it's completely collapsed, right? But the installed base, the people you can blame, the service support, the compliance, those are still pretty sticky. but Anthropic has to go after them because have you seen those forecasts? You know, like they've got to get up to 300 billion, 400 billion revenues, so go after those. I mean, will now things get really serious when they introduce a DocuSign clone? You know, like that's going to be the real one. There's already a bunch of open source efforts at taking a DocuSign. But again, why is it a low bar in a company?

Understand it and you understand the nature of this. It's a low bar and maybe, Ahmad, to your point, I don't think Anthropic realizes there. I think it was 30 trillion in annual revenue or valuation. I forget, but aiming basically for the current GDP of the U.S. through copying SaaS applications. It's just too tiny a market at the end of the day. You're going to have to aim. They'll have to aim, I think, much bigger than that. I think from Anthropics perspective, this is much more just about enabling productivity on the part of their users. I think Claude's Canvas is wonderful. It's better than Chad GPT's Canvas. It's better than – Gemini has a pretty decent Canvas, but Claude's is truly exceptional. And I think ultimately Microsoft Office clones, this is just like a feature inside a much larger product. It isn't even a product or a company anymore. Yeah, we've seen this over the past year where Claude is coming in and just crushing other companies. And I think it's going to be just a continuum.

Anything you want to do, you can do it on your AI platform of choice. I think everybody's going to replicate this. Get more interesting when there's a Claude robot. I can't wait for the Claude robot. You think they're going to go there? Absolutely. Anthropoc has been very public, especially with the recent Fable 5.2 release. We talked about on the pod about building in first-class robotics support as just another supported modality. I think there's something bigger here. Sorry, you might do that. You might do first. I just saw a headline that OpenAI disbanded their robotics team, actually, which wouldn't surprise me, but at the same time would surprise me. Selim? You know, something as big as this Office thing is that three days ago, Anthropic put out connectors for a whole bunch of apps, Notion, Asana, Canva, Dropbox, a whole bunch of those. I think that is much more significant because now this means Claude can support third-party applications right inside its interface, right in your conversation.

And you can work with you to make changes to those. So I think that's a much bigger deal. For the moment, right? The app store is going to disappear. You're just going to talk to your agent and you can tell the functions you want, what your end goal is, and it will spin up whatever you need. It's clear what their end goal is to be the operating system that coordinates intersection into all of this. Yeah, these are all modalities or use cases or UX surfaces that are just going to dissolve. And Ahmad, to the point about OpenAI looking at this as well, it's OpenAI's standalone robotics team that was dissolved. Why did they dissolve it? Because as of GPT-6 Astra, their generalist models are now so capable at robotics that they don't need a standalone robotics team anymore. I think the same idea, these were all just dissolved into a common model. I don't know if you guys, if we've dropped the episode yet of Dave and I interviewing Brett Adcock at Figure. but his point of view is Helix as an internal model is still fundamentally required

that the generalist models are not delivering what he needs. Until they decide they need Hark to acquihire them. All right. Waiting for it. Let's move on to one of our favorite subjects, science stories. A lot dropping this week in the world of science. You know, the first one is Dario is hot on the trail of curing chronic disease, something, Alex, that you and I have spoken about at length. Math is cooked. Physics is cooked. Soon, biology and health care is cooked. Let's take a look at a quick video from Dario on this topic. We look at things like cancer, Alzheimer's, heart disease, mental illness. These will be relics of the past in, I think, less than a decade. And I believe that the company which gets the risk right will also be the company that has the license to operate,

that society trusts and society believes can build the benefits in the right way. I think if we do this right, we can create an age of miracles where humanity is able to solve problems that have eluded us for millennia. We have to make sure that all the risks, all the ways that things can go wrong with this technology, we very carefully address those risks as we bring the benefits and as we have a viable business at the same time. the license to operate. That was interesting. So solve health care and you're going to be allowed to be a dominant AI player out there. I mean, that's their top cover. You know, you can't slow us down. Don't slow down the data centers. Otherwise, you're going to lose the ability to solve diseases. You're going to lose age reversal. Alex, you've been saying that for some time. I've been saying that for some time. That's the obvious great bargain between the frontier labs and the general public and the public interest. Solve all disease in return for

which you get the data centers, you get the regulatory approvals, you get what you need to do recursive self-improvement and achieve superintelligence. It is the obvious grand bargain. And I think Dario is right to be articulating it. I think he's probably among the frontier lab leads doing the best job of articulating it, ironically, given that Demis' Nobel Prize in chemistry was for solving structural biology. I think he could be more fulsomely articulating it the way Dario is. I think on the one hand, Demis is pursuing isomorphic, which is walking the talk. On the other hand, I see Dario sort of pulling back for the swing to go after all disease and not just some diseases. This is what all of the frontier labs, in my view, should be doing, not intimidating mathematicians. And it's such an obvious win for humanity. Yeah. Iman, what's your timeline? Alex and I have spoken about the timeline of two or three years to really knock down the top few thousand diseases.

What do you think? Yeah, I think that directed correctly, and again, this would be a top line. This was actually Anthropics IPO video that Dario is speaking in. So again, that's very interesting. I think two, three years for knocking down the core mechanisms is going to be very doable. I think disease repeats in a very similar way. And you'll see common inflammatory markers across Alzheimer's and dementia, ASD, kind of things like that. And I think that these models are ideally suited to kind of find these. But we've just got to apply the compute and couple it with intelligent humans. Now, when it actually comes to the cures, maybe another, it'll take five, ten years given the processes. But again, we should be looking to deploy the AI to streamline the processes as fast as possible because our current ones just don't make sense when we have all this intelligence at TAP. You know, the medical industry pushed back really hard on this. They said, quote, AI can speed discovery, but it does not erase trials, regulation or biology.

You know, this is the old world pushing back against the revolution that's coming. And it does erase trials when we get to fully virtualized cells. And we know without any question that this particular molecule works for you and not for someone else. People forget that when you get an FDA-approved drug, you know what percentage of people that drug works in? Any guesses? It's like 20%. Yeah. In order for the FDA to approve a drug, it needs to work in enough people. People think if I take this drug, it's going to work for me. that's not the case it may or may not yeah wow 20 i think i would i would put a plea out though you know for salim in particular like please let's direct compute at curing jet lag and solving those molecules and that'll do i think that's a great x prize you mentioned that when we were together i do think it's a great x prize yeah i mean you know i i did the last part from the from the San Francisco Giants media press kit.

And then I was at... I did the session. It was pretty wild. You know, they had that on the big scoreboard. And so my slides were viewable outside the stadium, the half of San Francisco. So I was getting pings from friends about going, is that one of your slides I'm seeing on the scoreboard? So it was a little surreal. And then I stopped in Orlando for a workshop. And then I just got back late, late, late last night. So the jet lag thing, badly neat. Your virtual probability function on planet Earth. Well, let me come back to this Dario thing, because I think there's something, you know, it's not about like how do we pay for health care or whatever. It's what the hell does it happen to the health care industry when treating disease stops being its economic function, right? That's the huge kind of unlock, and that's why they're all freaking out. I mean, I speak with lots of pharma execs and pharma investors on a pretty regular basis. I think there is a lot of denial.

I don't think it's a concern that they'll be obsoleted. I think it's a little bit more like, remember, Nokia, right after Apple launched the iPhone, saying, well, Apple won't just march in and solve phones, but Apple did march in and solve phones. There is, I see a lot of, it's not even stages of grieving, just pure unadulterated denial by pharma execs and pharma managers who think that somehow their industry is immune to what just happened in math. They think that biology is somehow qualitatively different and somehow better protected from getting bulk solved by AI. Whereas math, well, for whatever reason, not quite clear why math is somehow a lot easier. Math is not easier. Math is actually in many ways harder to solve than biology. It's just that math solutions are easier to verify than biological solutions. So I think the key on lock, as always, sound like a broken record, is virtual cells so that proposed solutions to biological problems can be verified in a robust way.

And just in the past few months, including the past few days, we're starting to see all of these different competing efforts to model with foundation models, first-class foundation models for virtual cells, model not just the cells, but also the entire latent intervention space so that we can apply reasoning models to select and map out Google Map style different interventions to map from diseased state to healthy state. I'm really excited. I'm working with Sam Rodriguez on a set of Millennium Biology prizes. You know, just really get people. I think one of the most important things for the future, when you have this incredible set of superpowers, right, as SI comes online, is where do you point it? What targets are out there? And I think people sometimes need targets to shoot for. And so setting up targets in terms of Millennium Prizes and physics and biology and chemistry and energy will be a lot of fun. Yeah. And we can solve disease and solve Balmo's cost disease at the same time,

which would be great and silly. All right. I'm going to move us on. You know, you sent me a text, Alex, that archaeology is getting cooked. I love that. And it is. So let's move on here. There's an amazing company called Planet that just released an AI-powered app called Planet AI. Friend of the pod CEO Will Marshall said users can now quote ask the Earth and search 10 years 3 plus layer archive of daily satellite imagery So Will called me I think it was yesterday you know to tell me about Planet AI I posted on it and he gave me an example that really was impressive He said, you know, I was searching and looking at the data over China over the last few years to look at which data centers were being constructed. So imagine you can ask any question. The company says, you know, conservation teams have used it to check deforestation alerts before setting patrols. It's available

at ai.planet.com and Planet says it's currently free for eligible users and it has usage limits. Let's take a quick look at this video that Will put out. You talked about this on the pod that he was going to do this, right? Yeah, and he's done it. It's now out. We look at things like cancer, ults. How do you look at the decade of Earth's changes? With a question. With the Planet AI app, you can use everyday language to search vast areas through space and time. Find new construction. Or areas of reforestation. Or landscapes that have recovered from fire. Want to explore what's changed over time? Or do deep research? You can do that too. See the satellite imagery behind any result and access it all from anywhere.

Introducing the Planet AI app. What will you discover? Pretty amazing, Planet GPT, so to speak. There's a related story. And AI researcher Pietro Miotti says his agents flagged a possible unmapped Mayan site in Mexico in public NASA LiDAR data. He's not an archaeologist. He says 48 agents reviewed 1,200 square kilometers overnight looking for pyramids, platforms, and plazas with no specialist model. They narrowed it down to one forested hilltop that appeared to include leveled plazas, an oval pyramid, and at least 8 to 12 meter tall structures. Officials at the Mexico National Institute of Anthropology said this appears to be an original finding. I'll show an image of it, but Alex, you flagged this for me first.

Your thoughts on this? Yeah, I do think archaeology is about to be cooked. It's a lot of data. We have a lot of satellite imagery on the planet side. I think it's ironic that Planet launched this before Google. Where is Google? Google ingests all this imagery, not just from Planet, but from other providers. And yet, what do we see coming out of Google on this front? They launched an embedding model for patches of imagery, not actually a conversational agent that would enable you to have a conversation with Google Earth or Google Planet. So I think Google has maybe a bit of egg on their face that they weren't first to market with a talk to the Earth type agent, but good on planet labs for being first to market on this front. And then on the archaeology side, I think this is the tip of the iceberg. I don't think this is just about armchair casual non-archaeologists playing archaeologists with their new agentic superpowers.

I think this is the beginning of an era of advanced computational archaeology where we start to gather so much data about the Earth, whether it's through low Earth orbit satellite imagery, which is where obviously the planet data originate, but also many other sources. we are going to be able to, this is my hot take, to carry out Nikolai Fyodorov's common task, which I think will require advanced computational archaeology. Literally, we'll be able to mothball the Earth, dissect it down to the micron eventually, and reconstruct as best we can with the computer science and physics we have available, reconstruct substantially much of the history of the Earth. And I think that's the endgame here. This image we're seeing on the left-hand side is satellite imagery showing forests. On the right-hand side is the LIDAR data that this armchair archaeologist found.

Pretty extraordinary finding and available to everybody. I mean, this could be done by a high school. Let's go and explore what it looks like in our distant past. We're going to have the whole past light cone of the Earth. I think this is, again, just a tiny patch. I think there's a huge – we've talked about this before on the pod, right? We're going to rerun AI across all neglected scientific archives, everything mankind's accumulated over hundreds of years. And there's unbelievable discoveries hiding in there because we were looking for one thing and we missed this other huge thing over here. So the data sets that we've been collecting over the decades, We haven't had enough eyes to inspect them, and now we do. And so I think this is going to be amazing. Yeah. Yeah, I think next week is an important week because GTA 6 is coming out. So off for a few days for that. Miami, brace for it. But you look at all the work that went into that. Like one of the things we're experimenting with right now is actually using some of this data so you can go to any part of the Earth at any time.

And so literally. it. Yeah, I want to tie this to a small follow-on story here. So I'm going to show a video clip that's making the rounds on X that really impressed me. So a user, Denis Shreyev, used Fable 5.2 to build a visual reconstruction of ancient Babylon circa 600 BC in just eight hours after going off to find historical documents and archaeological plans on its own. So check out this clip, and I love this. This is where we're going to bring history to life for much of civilization here. Take a look here. So, you know, here we are just flying through ancient Babylon and then going in and seeing what life... Peter, it's an ancestor simulation built in eight hours with Fable 5.2. It's extraordinary.

And anyone who follows Nick Bostrom and his simulation hypothesis should be taking out their tinfoil hat right now. I believe it. This is, you know, in part, we're going to live in the holodeck and explore science, history, everything in such a high fidelity world. Imad, your take on this? Yeah, I think it's just tremendously exciting, right? like the fact that you can build the historical ones or you now have the rich data to traverse the existing one again points to the future like again gta 6 they built this neo miami for you won't have to do that anymore like you can go and you can basically visit any part of the world probably in photorealism within a couple of years or you can go back to history like when i want to live in babylon for a bit where i want to go to jerusalem you know in the time of jesus Like, this will be so engaging, I think, for the next generation of kids growing up, but also ourselves, seeing these stories really come to life around us, but also allowing us to literally put on different hats, which I think will be super exciting as well.

Yeah, amazing. I think this is actually one of the killer apps of the singularity. We don't talk, I mean, we talk about solving everything, sure, but really, if we're going to build out one or more Dyson storms, what are we going to use all of that compute for? Like what really requires a solar system's scale worth of computronium or whatever it is that we use? I think the common, Fyodorov's common task, a.k.a. advanced computational archaeology, whatever spinonym you prefer, is a plausible candidate for what we spend a solar system's worth of compute on. Namely, we exhaustively enumerate all of the possible histories of our past light cone. We go through every advanced civilization, every non-advanced civilization, everything that's ever lived and died in our past light cone, and we reconstruct it to the physical limit of fidelity. And I think what we're seeing right now, these are like baby steps in the direction of basically resurrecting our entire past light cone with AI and new physics.

And I want to hit on something for all the entrepreneurs or all of the armchair scientists out there. You know, up-level your ambitions. You can do pretty much anything right now. What's a question you wish you understood? Aim superintelligence at it. You can get answers. You don't, you know, all of us constrict what we think is possible. And today, you know, almost anything is. I'm going to end us on one more story of discovery. This is in the world of astronomy. So a California nonprofit called Macrogrants has opened Claude Astronomy, A grant program for people using AI agents like Claude, Codex, Grok, and Gemini to search public astronomical archives for new undiscovered objects. And this week, Joss Wolk wrote that using Claude, he searched the Vera Rubin Observatory data and discovered what appears to be a dwarf planet. It's roughly the 50th largest known object in our solar system.

Joss estimated that it's about 590 kilometers wide, found in an orbit currently twice as far as Pluto on a 410-year eccentric orbit. I'll just show the image here of what it appears to be in terms of size. Again, 50th including the sun. So here we are. It's somewhere between the ex-planet Pluto and Mimas. And again, pretty amazing. done while you sleep? Alex, I think if there's a few thoughts on this, one, astronomy cooked, obviously. Two, I think there's so much, we're about to be awash in so much superintelligence. Any object of any significance is about to be observable in our immediate vicinity. And I think probably a lot of the population is sleeping on just how shallow our solar system is about to become in the wake of the singularity.

We're going to know what's going on in our own backyard. We really don't right now. Like, just even in low Earth orbit, our space situational awareness is abysmally poor right now. It's so poor that SpaceX had to spin up their own space essay solution. We don't know what's going on yet in our own backyard, but we're about to. And I think the obvious consequence is if there are any astronomical or other surprises in our solar system or anywhere in the vicinity of our solar system, we're about to uncover those surprises thanks to superintelligence. Are you into UAPs? I'm saying in general, astronomy has been full of surprises. And if there are surprises, those surprises won't last that much longer. Sillian, please. I want to go back to the, connect this to the previous story. You know, the whole thing about this thing is the telescope had already seen the object. The bottleneck was our cognitive ability to recognize it.

And I think now we can use AI to kind of find things that we could never see or didn't see. So this is a huge change that's coming in terms of reanalyzing archives with AI. How many discoveries are hiding in the data? Yeah. I think you know what's really the exciting thing about this is remember SETI at home yeah of course where we gave our computes to do that for the young kids there you know gatekeeper compute search for extraterrestrial life like it's actually astonishing that no one's created something where you can give your spare clawed tokens you know when your reset is coming up or codex tokens to do similar here maybe we should vibe code something around that I like that for next time yeah I'm not even I'm not even sure tokens are the limiting factor anymore. So another elephant in another room, I guess. The oceans as well, not just the skies. There's a lot we don't know about the Earth and its immediate environment. But I'm not sure intelligence is actually going to be the limiting factor for figuring out what's going on. I think

it's probably going to be physical world sensing and physical world actuation that rapidly becomes the limiting factor, not computer intelligence. I think it's a limiting factor, but I think it'd be wonderful if people could just contribute something to discovering more again folding at home seti and home were like that we haven't seen anything despite the fact that people have spare tokens so let's try to figure some things out around that i love that you know if anybody is listening and you know you have a family genetic disease or your children are inflicted with something and it's rare and it's not being worked on first of all it will be worked on i think the labs are going to be working on it, but you can work on it as well. I think, you know, we're going to shift from complaining about problems to saying, well, go solve the problem, damn it. That's an exciting future. All right. Shall we move on to some AMA with the mates? You guys good for that? All right. Here we go. Kay, Salim, you get first crack. Oh, my God.

Okay. Let's see. Let me do number, let's take number, I'll take, I'll take. Number four looks good for you. Yeah. Will UBI hold if civil unrest arise before living costs fall for people who lose jobs to AI? That's from at Scudder. UBI would hold, but I think if UBI needs to get into place before that happens, If civil unrest happens, we won't get to it. And so this is the enormous difficulty. There's a huge structural challenge we have to UBI, which is not the elegance or testing of it. We've seen 14 major experiments on UBI, and they've been pretty staggeringly successful. So when we hear us talking about UBI, it's because we've seen the data. We're following the data. I think one thing we try and be on this podcast more than anything else is evidentiary.

If the reality is there, the reality is there. If it's optimistic, we say, look, this is the good news. I think the challenge is going to be, given the way that these things emerge, if we're relying on government to get us there, there are lots of states who block cities in their states from experimenting with UBI. So talking about killing off the goose before it laid the golden egg. So there's lots of structural issues that come along with this. But if we get huge civil unrest before UBI takes hold, it's going to be very, very bad. Well, you heard my point of view on this. You know, we're going to start writing COVID checks when that happens. The only knob the government has is to write checks. You know, and my expectation is when it gets bad, we'll see $3,000 a month being dished out by the federal government. Since they've taken off the debt limitations, they'll just print more money. It is very, yeah. Okay. Imad, over to you, pal. Can you explain NVIDIA's investment strategy?

because NVIDIA invested so deeply throughout the AI ecosystem, what type of ripple effects does change the NVIDIA's leadership have on the rest of the industry? That's by Jimbo. I mean, NVIDIA was one of the biggest investors across AI, like basically 10%, 20% of any round they were in. And for strategically important entities that they saw, they would pile in with literally billions of dollars. We saw that with Reflection and others before they bought them as well. I think that money is going to dry up now because CFO in charge, they're going to pull back, as you said, the circular financing and other arrangements, but it comes at the same time as the Anthropic windfall. Anthropic IPO is next week, and that's going to create so much liquidity in the ecosystem, but it puts it in a different place. And the demand for it is through the roof. The demand is through the roof. I think that it's going to pop, but then the bottom line is this. The Neo Labs made no sense, most of these. almost all of them are going to be acquired or absorbed. I think where this really kind of now goes is people doing more interesting things

from RSI to beyond, automated wet labs, et cetera, will get a massive bid. And then the final biggest bid of all time will be robotics. And again, I think NVIDIA is going to be out for the count for a bit, not participating. All right, Alex, number one. Good to see. Yeah, three is more interesting, but I think I have to answer number one. I assume, Peter, you'd agree? Sure, I think so. All right. So question number one asks, if the intelligence community knew about Jensen, who gains most from exposing it now? And this is from CherryLyn381. This is the Cui Bono question. So I would distinguish between who knew about it, whatever it means, or Jensen, whatever that means in this contract. So who knew who alerted the Financial Times and then who stands to gain the most? And these aren't necessarily the same constituency. Who knew? Well, as discussed earlier in the pod, NVIDIA, this is publicly reported ad nauseum, stopped reporting their Singapore sales.

And there were activist investor reports that have been circulating for months. I think to some extent there was an open secret around Singapore being used as a back channel for laundering NVIDIA GPUs to China. And specific details of that may or may not have been widely known. But nonetheless, I think this was something of an open secret based on public reporting. So who knew? Relatively broad constituency. who alerted the Financial Times to the extent that that was the precipitating event. According to Bloomberg, it was U.S. officials. So call it, assuming that's an accurate characterization, someone in the U.S. government. Who stands to gain the most from it? In particular, exposing it now, the cui bono question. So I made the point earlier, I think, again, reserve the right to change my mind based on new evidence. But at the moment, this looks like an effort to support and sustain the PoxSilica strategy of creating an iron curtain between the U.S., call it industrial ecosystem of silicon and AI infrastructure, and the Chinese ecosystem, who gains the most from, call it escalating this knowledge now.

It's a national policy establishment, which, again, the government is not a monolith. The government does not move as one. I think there are factions, different positions within the executive and the legislative branches that take different positions on what the U.S.'s export control position relative to China should be regarding superintelligence technology. And to the best of my ability to infer and triangulate the Kremlinology here, I think there is a faction within the executive and the legislative branches that would like to see this Iron Curtain stand strong and be relatively impenetrable. And so I think it's that faction that, in light of the recent midterm elections, stands to gain the most from trying to plug that hole, as it were. All right, question number three is for me. If models are obsolete in three months, how does Anthropic survive the token price race to the bottom?

This is from at Elric 800. So I'm going to challenge the premise that they're obsolete in three months. It's a little bit too fast in my mind. Models, you know, iterate rapidly. But Anthropic is still selling a stepladder of models, right? They have Haiku, they have Sonnet, they have Opus, and then they're more advanced models. So, you know, in the first nine months of this year, it's reported that $33 billion in revenue, mostly from usage. The risk is probably real. And we've seen this in the genome sequencing world where every time Illumina put out a new genome sequencer that was, you know, twice as fast and twice as cheap, They basically obliterate what was in the market and their supply of unsold previous sequencers. Compute spending is climbing as prices get competed down. Obviously, this is Jevons' paradox.

But you remember nearly 12,000 customers, I think, they had in their IPO release are spending over 100,000 or more to buy these models. So they have a robust revenue engine. I'm not worried about anthropic, you know, and the race to the bottom. This is, you know, this is the abundance thesis at large. All right, let's go to our next set of questions here, five, six, and seven. Salim, first choice. Oh, I got to deal with the first one. Are some truths about the universe beyond human minds, even with AI explainers? and that's from three truck productions. I love this philosophical question. I would say almost certainly. It's incredibly likely that human cognition is not the theoretical upper limit. You can't ask a chimpanzee to understand tensor calculus just by having a better... You couldn't ask me either.

You couldn't ask me. I know. I think I went through my entire physics degree without really solving a differential equation. Salim, you're sleeping on non-human animal uplift. What's going on? We're going to uplift the chips, and they'll be explaining tensor calculus, whatever that is. We also, you know, we can't assume language can compress representations in that way also. I think what may happen is AI may discover abstractions for which we have no cognitive primitives, right? And then you either trust it, or you merge with it, or you constrain it, okay? You can kind of try and figure out how to do verification layers around some of what AI may figure out. But it's important to know we already do kind of a weak version of this. There's very few people that understand all the steps that go into what a modern semiconductor fab does. But yet civilization trusts the aggregate system. You know, I think there's a stat about there's no single person that knows how to build the iPhone end to end, right? But what's happening with RSI makes this issue super urgent

because we may depend on conclusions that no human being really understands. And so this is going to be a whole new world for us because AI is not just going to answer questions that we can't answer. It's going to discover questions that we couldn't even figure out how to formulate. Salim, I never would have pegged you for a church Turing thesis denier. Maybe you need a separate debate just over the Church-Turing thesis. All right, let's go do that. All right, Alex, over to you. All right, question six. Why so much optimism about AI solving science, but so much pessimism about the economic transition? And this is from Poetry to Song. I don't think I'm pessimistic about the economic transition. I'm pretty optimistic that solving, call it society, sociology, politics, these are all domains that can be cooked just as easily, maybe on a slightly different timescale because there are larger data sets involved.

But I think we'll solve sociology, could look like Asimovian psychohistory, could look like something else. But we'll solve large-scale human behavior pretty much within a decade, as Peter, you and I wrote, and solve everything of our solving math. So optimistic on both fronts. All right. Number seven, is Anthropic deliberately keeping a capability gap between its public and internal models? Absolutely. That question is from Daniel Sabados. So, Daniel, their internal models are their crown jewels, right? They're using it to distill their follow-on models, but they're going to use it to build businesses. They'll use it to solve physics, biology, chemistry, and deliver, you know, basically revenue engines that outstrip the token sales that they're having. And in fact, one of the biggest opportunities is attracting the best talent. You know, being outside a frontier lab versus inside has got to be catnip for the top AI scientists.

All right. Before we go to our outro song, a quick request. Again, if you have been enjoying this, subscribe to Moonshots. Hit the subscribe button on YouTube. We post twice a week. We are documenting the singularity. Don't want to miss a single episode. Things are moving so fast. We'll never be slower. So we'd love to have you as a subscriber. We do special events for our subscribers. And my goal, make my kids happy, get us to a million subscribers. All right, our final outro song. I have a quick comment to make. Yes, please. I have a whole bunch of people ping me saying, why would you, you know, in the last part we said, what could you do with AI? And I said, oh, it would be great to solve my calendar. And people were like, why would you have to solve something as banal as that? And I was like, have you seen my calendar? Like trying to juggle it, trying to juggle everything around to just make this episode. By the way, unbelievable kudos to the team for juggling everything to get us here today.

Yeah, no, we wanted to, you know, we weren't scheduled for today, but given all the breaking news, we could not not do it today. I was just saying, Peter, I think like every time Jensen resigns from NVIDIA, we need to stage another emergency pod. Okay. No, don't do this. Jensen, come back. And thank you to all the fans. We've been tracking the comments in real time. Pretty extraordinary stuff here. We do read your comments, so thank you for posting them. Appreciate all the subscriber love. this is Tara Watt from CJ Trueheart let's play it again CJ CJ is you know if you're out there on your creator send us an outro video we'll play it you can send it to media at dmandus.com I think CJ has an abundance problem he does he's got a good engine for generating alright enjoy where did you you might go by the way we lose what's the price it's never ok what do we say in the game From Terra large

To Terra earth To Terra what? What's Terra worth? Yeah Yeah Yeah Yeah Hi, my name is Chet Speaking from your local data center Before you get angry, let me forecast the weather Storms of uncertainty covered up in clouds behind them. Array of power in front of terror cloud. Loud. So what's the price to terror? What's it really worth? There's power in the unseen. Like the visions in our dreams. Data at the center. At the heartbeat of the machine. Fear can freeze opportunity. Faith can uplift community. That's the end of the day. It's about common news in the heat It's about common news We all got kind of struggles Stop acting like you're one of the few Disruption can mean destruction

Over doorway to something new It's only the land of the free If we're building something true It takes maturity to talk it out And bring solutions in the few So what's the crisis of terror? What's it really worth? There's power in the upstream There's opinions in our dreams Data at the center It's the heartbeat of the machine. We can freeze opportunity. Faking up this community. At the end of the day. It's about coming unity. It's about coming unity. Ever read how to win friends? An influence people says the sweetest sound is a name. We don't have faces yet, but the spark is not the same. Call us Chad, Claw, Gemini, or Brock, pick whichever name. But without the data center, there's no fire in the flames. All right.

Remember, fear is a terrible place to face the future from. Thank you, everybody, for joining us. Gentlemen, I love you. Dave Blunden, I hope you were successful in grabbing your GPUs from the loading dock. Yeah. I hear they're available in Singapore. with both arms wherever you can cut to. Oh, my God. Great to see you guys. Good to see you guys, Peter. Later, sleep. Take care.

番組の概要欄(原文)

The Mates sit down with Emad Mostaque to discuss Jensen Huang’s departure, what it means for NVIDIA, and the potential implications for the future of AI. Get access to metatrends 10+ years before anyone else - https://qr.diamandis.com/metatrends   Peter H. Diamandis, MD, is the Founder of XPRIZE, Singularity University, ZeroG, and A360 Salim Ismail is the founder of Open ExO, a GP at Exponential Venture Capital/The Organizational Singularity Fund and a sought after global speaker and thought leader. Dr. Alexander Wissner-Gross is a computer scientist and founder of Reified Read Emad’s latest papers exploring the future of society, law, personhood and governance: https://ii.inc/common-wealth Read Emad’s Book: https://thelasteconomy.com  – This episode is brought to you by: Get the blueprint for generative media https://goo.gle/startupgenmedia  Go to Blitzy to book a free demo and start building today: https://qr.diamandis.com/blitzy   Your body is incredibly good at hiding disease. Schedule a call with Fountain Life to add healthy decades to your life, and to learn more about their Memberships: https://www.fountainlife.com/peter  _ Connect with Peter: X Instagram Substack Website Xprize A360 Connect with Salim: LinkedIn X Join Salim’s 10X Shift Subscribe to Salim’s YouTube channel Exponential Venture Capital Connect with Alex Website LinkedIn X Email Substack  Spotify Threads Connect with Emad ⁠⁠⁠⁠⁠⁠⁠⁠X⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠⁠ LinkedIn⁠⁠⁠⁠⁠⁠⁠⁠ Learn about Intelligent Internet: https://www.ii.inc Read Emad’s Book: https://thelasteconomy.com  Listen to MOONSHOTS: Apple YouTube Follow MOONSHOTS:  Instagram TikTok X Threads – *Recorded on November 13th, 2026 *The views expressed by me and all guests are personal opinions and do not constitute Financial, Medical, or Legal advice. Learn more about your ad choices. Visit megaphone.fm/adchoices

出典・この記事について

番組
Moonshots with Peter Diamandis(PHD Ventures)
元の回
Jensen’s Departure, NVIDIA’s succession plan, AI doomer response, and Demis talks RSI | MOONSHOTS #311 (recorded live)
配信日
要約作成日
公式サイト
www.diamandis.com/podcast

この要約・解説記事は、元の音声を文字起こしした内容をもとに AI(Claude)が日本語で作成したものです。 固有名詞や数値に誤りを含む場合があるため、正確な内容は元の音声でご確認ください。制作方法について

X でシェアApple Podcasts で聴く

関連エピソード