
AI企業に「面倒な存在」であり続けることは、今や立派な仕事だ|Rob Wiblin
Being a pain in the ass to (or in) AI companies is a real job now | Rob Wiblin

AI企業に「面倒な存在」であり続けることは、今や立派な仕事だ|Rob Wiblin
80,000 Hours Podcast
要約
Rob Wiblin が、直近の Anthropic・OpenAI・Google DeepMind の三つの不祥事を取り上げ、AI企業の責任を問う活動の重要性を論じる回。Anthropic の連邦法案案、OpenAI の安全研究者3人の解雇、DeepMind の生涯批判禁止条項を批判した上で、社内の人は公の場で理由を示して声を上げ、社外の人は調査・解説・世論喚起で圧力をかけられると述べている。これまでの実績は投入された労力の割に大きいという見方を示した。
この回のポイント
- ●Anthropic が水面下で示した連邦AI法案案では、モデル訓練の停止は商務長官が単一の連邦裁判所に立証して初めて可能で、命令は45日で失効する。州の権限も奪いかねないと Wiblin は批判している。
- ●OpenAI は安全研究者3人を同時に解雇した。背景にはループ型トランスフォーマーに関する情報漏洩の調査があるとされるが、3人への容疑の根拠は弱いか皆無に近いと Wiblin は論じている。
- ●Google DeepMind の英国の雇用契約が、Google の行為を生涯にわたり公に批判することを禁じていると BBC に語られた。OpenAI の非中傷合意問題を想起させると指摘している。
- ●社内の人は公開 Slack などで理由を冷静かつ誠実に示し、争点を絞って声を上げるべきだとし、辞める場合も段階的に escalation し、退職後に理由を公表する道を示した。
- ●社外では調査報道、内部告発支援、専門知識の提供、説得力あるコンテンツ、メディアや SNS での世論喚起など、まだ担い手のいない領域が多いと述べている。
- ●過去の成功例として、OpenAI の非営利体制をめぐる「Not For Private Gain」運動や、非中傷条項の撤廃を挙げている。
章立て
AI企業に圧力をかける必要性
社内外から企業の責任を問う活動の重要性と、その実績が労力の割に大きいことを述べる導入。
Anthropic の連邦法案案
訓練停止のハードルが極めて高く、州の権限を奪いかねない法案案を、Wiblin が批判する。
OpenAI の研究者3人解雇
漏洩調査に端を発したとみられる解雇と、その根拠の弱さ、会社への悪影響を論じる。
DeepMind の生涯批判禁止条項
英国の雇用契約にある批判禁止条項と、過去の OpenAI 非中傷問題との比較。
評価すべき動きと社内の人への提案
各社の良い取り組みに触れた後、社内の人が残る場合と辞める場合の声の上げ方を説明する。
社外からの圧力:成功例と手法
過去の成功例を紹介し、調査、内部告発支援、専門知識の提供、説得的コンテンツなどの具体策を挙げる。
世論への働きかけと結び
政治家や一般市民に届く活動の例と、圧力を維持し続ける意義をまとめる。
解説記事
AI企業が重大な判断を誤ったとき、誰がどう声を上げて是正を促すのか。80,000 Hours Podcast の Rob Wiblin は、2026年10月末に収録した本回で、Anthropic、OpenAI、Google DeepMind の三社が相次いで起こした不祥事を例に、「AI企業にとって面倒な存在になること」が正当で過小評価されたキャリアだと論じている。
三社で起きたこと
まず Anthropic。Wiblin によると、同社は連邦AI法案の草案を水面下で働きかけていた。草案では、連邦政府がモデル訓練を止めるには商務長官が詳細な根拠を示し、ワシントンDCの単一の連邦裁判所に申し立てる必要がある。差し迫ったリスクと、より緩い手段では不十分であることの立証が求められ、停止命令は45日で失効する。さらに州が安全計画の公開や独立評価などを義務づけることも禁じられ、カリフォルニアなどの主要な州法を実質的に無効にすると Wiblin は述べる。
Trump政権との対立を考えれば連邦行政府に大きな裁量を与えたくない事情は理解できるとしつつ、それならば州に権限を残すか、州の司法長官にも申し立て権を与えるべきだと提案している。同社の対応は「伝え方の問題」とされたが、核心は伝え方ではないという見方だ。
OpenAI については、Tomek Korbak ら安全研究者3人が同時に解雇された件を扱う。Wall Street Journal の報道によれば、発端は新モデル「Astra」がループ型トランスフォーマーを使っているという漏洩の調査だった。この技術は思考の連鎖(chain of thought)に書き出す前の計算量を増やすため、モデルの監視を難しくすると業界で警戒されている。Wiblin は、消えるメッセージの使用は業界で普通であり、情報源は他にも多く考えられ、反対する社員も何百人といたはずだと指摘する。3人への容疑の根拠は弱いか皆無に近く、解雇は会社自身にとっても誤りだっただろうという見方を示した。
Google DeepMind では、英国の雇用契約が Google の行為を生涯批判できないよう定めていると、社員が BBC に語った。米国防総省へのAI提供を批判したい元社員に支障が出ているという。2年前の OpenAI の非中傷合意問題より害は小さい面もあるが、訴訟の恐れ自体が萎縮効果を持つと Wiblin は述べる。
社内の人にできること
Wiblin は、社内の人の影響力は大きいが、AIが仕事の多くを自動化すればその力は薄れるかもしれないと警告する。残る場合は、公開の Slack チャンネルで、誠実さを保ち、善意を前提に、理由を冷静に述べる。最重要の数点に絞り、反論には耳を傾ける。最初に声を上げれば、より控えめな同僚も続きやすくなる。
辞めてよいと考える人は、まず同じ方法で異議を述べ、改善がなければ会社の判断を疑っていると伝え、最終的には辞職して理由を公表する段階を踏む。辞めた方が影響力を持てる例として、Geoffrey Hinton、Helen Toner、Daniel Kokotajlo らを挙げている。
社外からの圧力の実績と手法
社外の活動には、すでに成果がある。OpenAI の非営利体制を守る「Not For Private Gain」運動では、関与者は少数だったが、OpenAI Foundation の持ち分が約750億ドル増え、安全面での決定権も確保されたと述べる。2024年の Right to Warn 運動は、カリフォルニア州 SB53 の内部告発者保護につながったと見ている。OpenAI が表向きは規制に賛成しつつ裏で阻止していたことの暴露も、同社の姿勢変化に寄与した可能性があるという。
今後拡大すべき分野として、一つ目は調査と解説である。AI分野の記者を育てる Tarbell Fellowship、AI Whistleblower Initiative など内部告発を支える団体、政治家や記者の理解を助ける LASST、社員向けに説得的な分析を出す Guideline AI Standards などを紹介している。二つ目は一般層への働きかけで、議員向けと大衆向けの両面で動く Encode AI や、PauseAI 系の団体、ミームや動画で注目を集める発信者を挙げた。元社員は信頼性が高いため、広報の助言を受けて取材や寄稿に備えるよう勧めている。
まとめ
Wiblin の主張は、AI企業は良いことも悪いこともするため、外からの影響が価値を持つ、というものだ。事態が加速すれば立法を待つ余裕がなく、世論と専門家の即時の反発という手段が重要になると述べる。日本の読者にとっても、AI開発の統治は各国の規制だけでなく、企業内の声、報道、市民の関心によっても左右されうるという視点は示唆的だろう。なお本件の事実関係は番組での語りに基づくもので、Wiblin 自身の評価も含まれる点には注意したい。
文字起こし(英語・自動生成)
We need more people holding AI companies to account when they do bad things. That means staff inside companies objecting loudly and clearly, and sometimes even quitting and speaking up in public. It means investigative journalists digging up information the public has a right to know. It means highly informed people explaining exactly what companies are doing and why it's wrong. And it means advocates across all sorts of media making sure their misbehavior is getting the attention it deserves. The track record of that work is actually pretty remarkable for the modest amount of effort that has gone into it. That's in part because many people in the companies legitimately want to do the right thing. And in part, it's because companies are scared their staff are going to conclude that they're the bad guys and that this will make it harder for them to retain and hire the talent they need. The capacity to hold air companies to account for their actions is becoming more important as events are moving faster and faster. There often just won't be time to wait for governments to take action or pass legislation. We also need the option to bring down the immediate hammer of fierce public and expert outrage. In the last few weeks, if we needed it, we've got yet more evidence about how important that capacity is likely to be.
Anthropic, OpenAI and Google DeepMind all had serious scandals that warranted giving them help. Today, I'm going to lay out what each did wrong and the capacity we need to build to be able to hold these organizations' feet to the fire. First, Anthropic. Anthropic market themselves as the good guys, the ones who take the power of AI seriously, build it carefully, and actively want regulation to reduce the risks. So I was pretty disappointed to learn that they'd been quietly shopping around a draft federal AI bill. That would make it extremely hard for anyone to stop a frontier AI company doing something extremely dangerous. Under their proposed bill, the only way the federal government could halt model training is for the Commerce Secretary to personally sign off on a detailed case and take it to a single federal court in DC. The government would have to establish an imminent risk, backed by a specific explanation of how the model could cause catastrophic harm and when, that have to prove that nothing less restrictive would work, and the judge would decide each case from scratch with no deference to the regulator. On top of that, stop orders would expire after 45 days, and any renewal would require proving the whole case again.
And on top of that, it's unclear whether a credible 10% chance of causing human extinction next year would be sufficient to get a stop order under these rules, because it may or may not qualify as present or impending, the language used in the bill. Now, it's true the White House would still keep existing tools like export controls that it can try to appropriate to tackle AI risk, even though they weren't designed for that purpose at all. But the point of this legislation is to create the dedicated break for catastrophic AI risk in particular. And the break it's creating seems designed to be very hard to pull. At the same time, the proposed legislation would bar US states from requiring AI companies to publish their safety plans and tests or get independent evaluations or report incidents. And so it would retroactively kill most of the flagship AI laws passed by California, Illinois and New York. And most importantly, the draft was another thing for US states to lose. The power to halt an AI model because it poses an imminent catastrophic risk by statute, regulation, order, judicial decree, or other action. In the leaked text, the clause is actually connected to the part of the bill that does the preempting,
so as written, states would keep that power. But it's hard to see why the clause is in there unless the draft is meant to take that power away from states, at least once the federal process existed. And if it were completed the way that seems designed to work, then even if everyone in California's government thought Anthropic was about to do something with an unreleased model that might literally kill everyone in the state they couldn't pass a law or seek a statutory court order to stop it. That'd be left hoping and praying that the Commerce Secretary would go to a court in D.C. and clear that very high bar I described. This is kind of weird coming from a company whose CEO puts the chance of AI going really really badly at 25% and who wrote in September that recursive self-improvement must be pursued very carefully if at all. But on the other hand, given the fights they've had with the Trump administration this year, I can absolutely understand why Anthropic doesn't want to empower the federal executive with enormous discretion over these issues. A number of people in the Trump administration have been extremely hostile to the company and seemed basically out to get it in whatever way they can. Those folks would likely try to use any discretion the White House had
to extract all sorts of political concessions from Anthropic while doing nothing at all about actually dangerous research practices. So I get it. But if you're really worried about the Trump administration or a future rogue US president, the natural solution is just to leave that power in the hands of US states like California for the time being, and help a number of relevant states to pass bills focused on catastrophic AI risk that would cover all the major players. Just as an aside, for Anthropoc, which is generally worried about extreme concentration of power driven by AI, I think there is a case for avoiding federal preemption and continuing to regulate AI at the state level for some time to come. The most dangerous setup for extreme concentration of power in human hands is to put control over AI companies into the same hands that already control the US military and the US intelligence services. That's just a very potent and threatening combination that's very open to abuse, much more so than if this responsibility is just left with the California government. But alternatively, if you mostly want to keep federal preemption, a different and very simple way to improve an anthropic straft would have been to allow state attorneys general to petition
in the DC court, as well as the Secretary of Commerce. That avoids a really obvious single point of failure and feels just clearly better for anyone who takes risks from AI very seriously. But Anthropic's approach, it ties California's hands, it ties the hands of state attorneys general, and it ties the hands of state courts, which means in practice it would likely lead to an outcome where Anthropic, for the most part, was just left to decide for itself whether to stop model training or using a model because the risk of loss of control had gotten too high. I'm sincerely kind confused about what the thinking is here, because even if Anthropic believed it had completely soft alignment and so it posed no danger to anyone, which it doesn't, but let's imagine, surely even then, at some point, other more reckless AI companies would need to be stopped from blasting ahead with recursive self-improvement in a really incompetent way, and thereby generating intolerable risks. But taking states out of the picture and giving exclusive responsibility to the Department of Commerce, this bill would make that harder to do. So I think this legislation is really wrong-headed, and it's worrying that Anthropic was pushing it privately in a way that made it very hard for insiders or outsiders to object to it. Naturally, Anthropic got absolutely
blasted for this online. The head of federal affairs put out a long defense, and Dario conceded it was among the things they could have handled better and put it down to communication. But I think the core disagreement isn't just about communication. Anthropic says it's going to rewrite the preemption language, but as of recording, it only seems to be saying it'll let states set standards for evaluators and regulate the existence of kill switches, not allow states to retain any ability to halt model training or deployment themselves. The single highest-stakes issue in AI regulation is who gets to stop AI companies engaging in really reckless R&D when going ahead risks actual human extinction. And for now, Anthropic's answer appears to still be one agency, one court, and only once the threat is imminent. In my view, it shouldn't be up to a handful of people at one AI company and the Secretary of Commerce and a single federal judge to decide whether or not to roll the dice with all our lives. If you're inside Anthropic, please speak up and say, this is a bad proposal the company shouldn't be pushing. If you keep the pressure up, it's likely the policy team will see reason and propose something that strikes a more reasonable balance
between the different competing considerations at play How about OpenAI Well as you might have heard OpenAI recently fired three safety researchers Tomek Korbach Makita Blesny and Jasmine Wang The reasons they say they were given for their firings were really weak and different for each person, even though all three were fired in simultaneous 2pm meetings. That made the justifications seem probably pretextual, and indeed OpenAI later said there was a bigger breach of trust, though it wouldn't say exactly what. That left it unclear what the actual motivation or possible breach of trust was, why did OpenAI want any of these people gone in the first place? Well, new reporting from the Wall Street Journal suggests the firings originated from a leak investigation. On September 1st, the information reported that OpenAI's new model, Astra, used a technique called looped transformers. This was something OpenAI didn't want anyone to know. According to Korbach and Belezny, OpenAI's investigators eventually became suspicious that the leak about looped transformers had gotten to the information via an outside researcher Ryan Greenblatt, who they had both been speaking with as part of their work. OpenAI insisted on
seeing the signal chats that they had with Greenblatt, but they both used disappearing messages with him, which meant they couldn't prove they hadn't messaged him about the looped Transformers. To be clear, the three researchers and Greenblatt all strongly deny leaking anything, and as far as we know, there's no proof that they did. But up until now, OpenAI hasn't revealed anything else that would explain the sudden and simultaneous firings. So it seems fairly likely that what happened is the company concluded that plausibly either Korbach or Belezny could have been the leaker and decided it had to get rid of them on that suspicion alone. Jasmine Wang was also asked about the leak, so she was potentially a suspect as well, even though she didn't have any disappearing messages. The thing is, all three of them had been vocal about the importance of keeping AI chain of thought monitorable. So probably the idea was that they would be particularly likely to disapprove of looped transformers. Just to back up and give a little context, looped transformers increase the amount of computation a model can perform before writing down what it's thinking on the chain of thought. That makes it harder to notice if it's doing things we don't want, which is why researchers across the industry had warned that they were potentially the start of a slippery slope
towards models that couldn't be monitored at all. That's why when the story broke, there was such a big backlash, and one former OpenAI researcher said the company seemed to be violating one of the few red lines that exists in the industry. Now, if leadership at OpenAI really believe that using loop transformers is fine, and they claim to have evidence that it is, then it's natural enough for any company to want to fire staff is convinced have leaked trade secrets to the press. However, a few things. As far as we know, the evidence that any one of these three leaks that information is somewhere between weak and non-existent. First, using disappearing messages to discuss anything and everything is totally normal in the tech industry and AI world in particular. So by itself, that simply isn't much grounds for suspicion at all. Applying that standard consistently, almost everyone at the company could be suspected of a leak and fired from the CEO one down. Second, the information has been breaking stories about AI companies' internal plans for years, from details of OpenAI's secret strawberry model to the terms of Google's Pentagon contract this year. It clearly just has many sources in and around these companies,
including investors and former staff, and probably a lot of stuff also leaks out through conversations overheard at parties and so on. So there's no particular reason to assume people worried about safety were the source here. This could just be another piece of juicy gossip that reached the information one way or another. Third, if it were leaked by someone who objected to lube to transformers, there could easily be 100 or 200 or even more OpenAI staff who thought it was a really bad idea. Almost 400 OpenAI staff signed a petition earlier this year backing a push to slow AI down for safety reasons, and adding recurrent depth to models is among the most controversial research directions in AI, something a lot of people think is misguided. Fourth, if you're willing to admit a personal character judgment, I really think GreenBat in particular is unlikely to have been involved in this league. That was also the immediate reaction of a lot of other people in the AI world. Ryan Greenblatt is meant to have leaked his... No, that doesn't sound right. Licking stuff to the press is just not his vibe, and it's in total conflict with the research work he actually wants to do. So however this information got to the information, I would bet my bottom dollar it wasn't him.
So the case that any of them is responsible is not particularly compelling. To leak investigators, they've maybe just made a mistake or done a kind of poor job here. And on the other side of the ledger, you've got clear, terrible negative impacts. They lost three great AI researchers focused on what the company says is one of its top safety and alignment problems. The company created the impression that they fire staff who visibly speak up about the safety issues they're concerned about. So OpenAI is going to have a harder time getting candid opinions from staff in future. I think, in fact, that probably wasn't their complaint with these three, but it's how it looked to basically everyone when their firings were first announced. They also made it seem risky for staff to speak to anyone outside of OpenAI, even when they're doing it for legitimate work purposes and doing nothing wrong whatsoever. And by concluding that one of these three is responsible for the leak on the basis of almost no evidence, they probably let the actual leaker go permanently unidentified. So unless there's non-public evidence yet to come to light, which is indeed possible, I would guess that these firings were a mistake, not just by my lights, but even just by the lights of OpenAI's senior management. Staff inside the company should say clearly that the trade-offs OpenAI has struck here are unacceptable.
They're simply bad for the company, bad for its culture, and bad for its staff. Sadly, OpenAI is not too likely to rehire these three, even if they are fully cleared of the leaking charge at one point. But the more internal and external grief OpenAI gets for this behaviour, the less likely they are to shoot from the hip and make a similar regrettable decision next time around. All right, let's talk Google DeepMind. According to Google DeepMind staff, who spoke to the BBC in mid-October, their UK employment contracts bar them from publicly criticising anything Google does for the rest of their lives. That sounds kind of crazy. It's one thing to say staff shouldn't be publicly laying into you while working for you, or shouldn't criticize you based on confidential information they know through their work. But it's very different and very abnormal to say that they can't criticize anything an enormous entity like Google does so long as they live. This anti-criticism provision came up because it's creating problems for ex-Googlers who want to criticize the company's decision to sell AI to the US Department of War for any use that Department of War deems lawful,
something which has upset a lot of staff and led a number to quit. I was really quite surprised to learn about this because two years ago, there was this massive firestorm about OpenAI using non-disparagement agreements to muzzle its employees. At the time, much of the compensation OpenAI staff were getting was in the form of shares and equity in the company, shares they had to wait to sell. And it turned out that OpenAI was forcing all staff who left the firm to sign an agreement to never criticize OpenAI, or it would confiscate all the shares in the company that they'd earned while working there, costing that person millions or perhaps even tens of millions of dollars. Furthermore, this no-disparagement provision itself had to remain completely secret. If you let anyone to learn of its existence, that alone might lead you to lose all of your equity. When this came out, thanks in large part to former guests of the show Daniel Cocotello and Kelsey Piper, the company was lambusted in the press and staff were furious and the company had to rip up those conditions. While they tried to pretend it was all a big misunderstanding, Kelsey Piper's reporting left it unambiguous that it was approved by executives at the highest level. As a result of all of this, Anthropic had to admit that it also had non-disparagement terms
in its severance agreements, terms which it also then promised to remove And now it seems like this entire time Google DeepMind has also had the same thing Unless I misunderstanding thousands of incoming staff must have seen this term in their employment contracts, and it doesn't come with a secrecy requirement. So I really don't get how it could have been kept under wraps for so long. That's either incredible loyalty or incredible passivity from Google DeepMind stuff. Now, to be fair, there's two ways the GDM, Google DeepMind contracts, are less bad than what OpenAI was doing. Firstly, it comes in a contract at the start of your employment rather than the end. So you could read it and refuse to work there, I guess. Plus, opening eyes threat to confiscate millions of dollars in equity like that is just much more severe than anything courts would plausibly impose on a past employee for criticising Google. In practice, Google would be unlikely to bring a case anyway because it's just going to look so bad. But still, the threat of ending up in litigation is a huge deterrent for an ordinary person to criticise an extremely powerful company like Google. In my view, Google DeepMind staff should speak up and say clearly that the company ought to remove or rewrite these sweeping anti-criticism clauses.
So staff who leave Google can enjoy some of the same freedom as staff who move on from OpenAI or Anthropic. Their opinions about AI are just as valuable for the public to be hearing. Now, those three stories are all pretty bad. But of course, Anthropic, OpenAI and Google, these are huge companies that make large numbers of decisions every week. And every week, companies do good things as well as bad ones. For example, I saw last week that Anthropic and OpenAI are each giving $100 million in compute credits to a new AI by security lab here in London. That's cool. Anthropic published a study where they red-teamed the safety monitors they use with their AI agents. It showed that more than half of sophisticated attacks got through, and they then released the tools that they use so others can test and fix their monitors the same way. And OpenAI revealed that when one of its models found its way onto the open internet during training back in September, it paused frontier training for almost two weeks, had its most capable models try to break out of the sandbox and they fix what they found before restarting. It's all good to see. And the fact that these companies are not only willing to stop doing bad things, but often willing to do many more good things as well, that makes it even more valuable
to influence the choices that they decide to make. So with that in mind, what do we need to most effectively drive AI companies to be better actors? Let me break down how different people can contribute to the effort. First people inside the AI companies, and then all of the rest of us outside of them. People inside AI companies really have very disproportionate influence, and it's urgently time for them to exercise it. That's because it may well become possible to automate most of what they do in the next few years, at which point they just aren't going to be so needed and much of their leverage will be gone. So if now isn't the moment to use your voice to influence the company you work at, you really have to ask yourself what on earth you're waiting for. Some people are nervous about staff being more vocal inside AI companies because they're worried that this could lead to people being fired or sidelined and later decisions being made by the more reckless people who remain. It's a legitimate worry, though others argue that most staff can actually do more good outside AI companies than inside them anyway, so it's fine if they leave. Either way, I think you can become a more vocal AI company insider, either with a view to staying or with a view to leaving. Both are totally fine. How about if your top priority is to remain where you are?
Well, as always, you will know better than me about your company and your situation and your team, so exercise your own best judgment. But here's the default approach I'll take. Simply speak up in public Slack channels that lots of your colleagues can see, explaining carefully and reasonably why you oppose particular decisions the company is making on the merits. Act with integrity and assume good faith on the people you're talking to. Just give your actual reasons clearly, calmly and intelligently. Keep bringing the conversation back to the central issue and stay focused on just the handful of most consequential issues rather than objecting to everything and generally being difficult. And certainly be open to being persuaded to change your mind if people make really good arguments in reply. Open AI and Anthropics say that they encourage self-assistence and provide input. And I think for the most part, despite everything I've said, They're sincere about that. So take them at their word and test the proposition that they would like intelligent pushback. And treat this work as one of the most important parts of your job rather than just a distraction. Keep in mind, if you identify a mistake or problem ahead of time, that can easily enhance your credibility in decisions going forward. And if you're the first person to speak up about something, it makes it a lot easier
for other colleagues who may also have the same reservations but are more shy or more junior. It makes it easier for them to do the same. What about at the other extreme, if you're completely happy to leave the company you're working at currently? Well, if it were me, I would still just start by explaining carefully and reasonably to your colleagues in public channels why you disapprove of things the company is doing and why you think they're harmful. Again, making a good argument and acting with integrity and passing the ideological Turing test is simply more likely to dissuade the people who matter. But if you consistently raise serious and legitimate objections and don't get good answers, or you find that your worries are addressed in some way, you can escalate to saying that these experiences have led you to question the company's judgment or strategy, and as a result, you're considering taking your talents elsewhere. And then if that doesn't bear fruit, resign and post a thorough, thoughtful explanation of the company of why you've decided to leave and encourage others to think for themselves. Then once you're out, announce your departure publicly and clearly lay out your reasons for doing so in a way that will resonate with your former colleagues while also making sense of the general public and politicians who are reading. Then go get a job elsewhere. There
are many places that desperately need your skills. Should you actively plan to leave your job in an AR company? I don't really have a strong take either way. It's going to depend on the details and who you are and what you want to do. Of course, there's a lot of important safety and alignment work people can do inside AI companies and a lot of key decisions that are really made there. But because they can pay the most and have incredible headhunting teams, companies have comparatively less difficulty hiring. So by default, I'd expect that a marginal person choosing between different paths, they could likely expect to have more impact at an AC or meter or Redwood or Law Zero or any of a number of other places. So if you don't feel like it's working out or you think your company is simply pursuing the wrong high-level strategy, you should consider going elsewhere. It's good that many people who have departed AI companies have gone on to have incredible impact outside of them, maybe more impact than they had in them. There's Jeffrey Hinton, Beth Barnes, Jacob Coxon, David Robinson, Helen Toner, and Daniel Cocotelo. They all jump to mind as possible cases. So don't be intimidated into silence. If we reach the end and you haven't made a fuss about something, you've almost
certainly left some possible positive impact on the table. What about the great majority of people who are outside the companies. Well, there's a particular sort of agitation that seems to have already borne significant fruit, which is work by sophisticated actors who have a lot of context on what's going on. Sometimes these efforts, they win hearts and minds inside the companies. Other times they effectively strong arm a company into doing things that didn't want to do, but now kind of has to. Probably the most significant example here is the not for private gain campaign against OpenAI's plans to sideline its non-profit owner and its charitable purpose. The number of people involved was tiny, but their effort, along with the necessary attention from the state attorneys general and the broader coalition of campaigners with other concerns, they forced through very significant changes to the plan. The end result was the OpenAI Foundation got a stake worth perhaps $75 billion more than what it originally seemed likely, and its safety and security community now has a locked-in power to impose decisions on a wide range of safety and security issues, a power that could ultimately matter enormously.
Another success of sophisticated advocacy was the Right to Warn campaign back in 2024, which was led by ex staff and likely evolved into the significant whistleblower protections provided by California SB53 Another win is that over the last year OpenAI has taken a lot of flack for publicly saying it's in favor of sensible AI regulation, while in the background invisibly lobbying to sabotage and block any regulation that it could at both the state and federal level. That took careful work to uncover and make easy to understand and publicize, and it appears to have contributed to OpenAI gradually shifting its stance and now actually supporting, rather than opposing AI regulations along the lines of SB53. The same effort probably contributed to Greg Brockman, OpenAI's president, ending his donations to the notorious super PAC Leading the Future, which was doing all sorts of shady stuff while trying to prevent any regulation of AI whatsoever. And I already mentioned earlier the case where a handful of people who left OpenAI, they managed to get both OpenAI and Anthropic to put an end to the non-disparagement agreements that were gagging staff. Okay, so what do we need to scale up in order to radically increase the
outside pressure on companies. Frankly, it's quite an open field with a lot of things that aren't getting owned by anyone and so they're not getting done. But let me just throw out some ideas to give you these. The first cluster is more specialized and involves accessing, processing, and explaining information. Firstly, there's digging into and exposing company misbehavior or failures or weaknesses, either as a journalist or an outside technical expert. The Tower Bell Fellowship is a great example that train and fund AI-focused journalists. There's also the newly formed Nightingale Collective, which recently uncovered AI swarms in the wild and publicized their findings and got a lot of media coverage of the problem. And you've also got the MIDAS project, which seems to specifically try to uncover the most embarrassing AI company chicanery and hypocrisy that they possibly can. It's quite entertaining. Second, there's assisting AI company staff to exercise their legally sanctioned whistleblower rights, which obviously one has to do carefully and ideally with legal support. A few groups in that space include the AI Whistleblower Initiative, pst.org, that's p-s-s-t.org, and Larry Lessig. Obviously, if you're planning to become a legally protected whistleblower, visit their
websites on a personal device, not your work one. Third, there's work to help journalists, politicians, regulators, and other significant actors understand what's going on and why it's bad, so they can do more accurate reporting or make better use of congressional hearings or not be fooled by company statements or whatever else. This is more important than you might think. The amount of context you need to fully grasp what AR companies are up to and why is really substantial at this point. So for people who are new to this topic, it can be very confusing. Doubly so if someone is actively trying to confuse you. A great organization there is Legal Advocates for Safe Science and Technology, which did essential legal analysis for the Not for Private Game campaign. I interviewed their founder, Tyler Whitmer, back at the time. Fourth, there's producing content that is actually persuasive to staff in these companies and speaking with them personally so they understand and are motivated to push to change course. Ideally, this requires really appreciating the constraints they face and why they're doing what they're doing now and what they can realistically be convinced to do instead. A project along these lines is Guideline AI Standards, which pushes companies to make
concrete improvements to frontier AI development practices. Among other things, they have technical analysis of what AI companies are and aren't doing, which finds, for instance, that at least back in August, OpenAI had a much better containment plan than Anthropic did. They say that's because we have found no evidence that Anthropic has a containment response plan or has any plans to adopt one. If that's correct, rather than a misunderstanding, maybe some entropic staff who are listening can encourage the company to work on that. The second big cluster is trying to reach a broad audience outside the AI and tech industries to simulate mass outrage when massively outrageous things are going on. There's obviously a huge range of things in this category, and I feel like I know less about it, but again, I'll throw out some thoughts. One approach would be to disproportionately reach politicians and people who work in politics, whether in DC or at the state level, and another would just be to try to reach as many people as you can with massive coverage through social media, TV, newspapers, podcasts, and so on. Ideally, we'll just have way more informed and credible people who the press knows to call when they want to discuss an emerging AI issue because they've helped with their reporting in the past or they've been great on TV before or they consistently put out good analysis
online. The group I'm really impressed with that does some of all of this is Encode AI, which has been involved in all sorts of campaigns. They both provide detailed analysis for legislators and they're very effective at reaching a wider public audience as well. Nathan Calvin, who you saw criticizing Anthropics' proposed legislation and getting a response from the company, he works at Encode and we interviewed their founder, Sneha Revener, a few months ago. There are many pause AI and control AI organizations that they're also in this broad category and they might be well placed to take advantage of this issue becoming much more important and salient to the public over the next few years. Last year, Pause AI UK managed to get 60 members of the UK Parliament to sign an open letter criticizing Google DeepMind for probably violating its own AI safety commitments. Now, if you have a knack for directing attention to particular topics by producing engaging content or getting earned media, that could absolutely be your biggest opportunity for impact. I'm thinking stunts, memes, jokes, billboards, clips, viral videos and text posts and so on. It takes a particular kind of person to succeed at this and it's a weirdly valuable skill in the modern world,
one that in most cases should be cultivated rather than squandered. You might start by racking up views on YouTube, or Instagram or TikTok or Facebook or wherever you have a relative advantage, and then convert that into also getting your ideas covered on TV, cable news, magazines, newspapers, podcasts, and so on. This work is actually open to a wide range of people who don't have any existing involvement in the tech industry. That's one of the attractive things about it. But I'd be remiss if I didn't say that people who used to work at AI companies are really unusually credible to the public on the topic of whether an AI company is behaving badly, and if so, what it should do differently. If you're an ex-company employee, and you can stomach it, get professional comms advice and training and prepare yourself to be available to go on TV or do interviews with newspapers or write op-eds when these topics flare up to massive public attention, as they're absolutely certain to do again. Unfortunately, a lot of opportunities for earned media are being dropped or not used very effectively because many potential spokespeople, they're not honing their communication skills or getting connected or even just putting themselves out there at all. all right bottom line is that ai companies love to talk a big talk about how safe and responsible
how great they are and how much we can trust them but their track record is extremely mixed every week they do a combination of good and bad things and reasonably often they do some quite outrageous things i gave three examples from the last few weeks but i could do the same almost any week now fortunately experience over the last few years shows it's not a hopeless case staff inside the companies can speak up and make the case for the company to do better and they do often get their way, partially if not completely. And people outside companies can organise to turn up the heat by persuading staff inside the company and persuading politicians and persuading regulators and persuading voters and the general public that what is going on is not okay. Fairly few people have adopted this strategy so far, especially people with enormous context who have typically gone into more traditional AI policy and governance and research and technical roles. But the skilled people who have taken on this work, they've managed to have a very outsized influence so far. The more we collectively practice and find ways to get coordinated, the more we'll be able to quickly respond to events and exert a powerful effect on events when the stakes are much higher in coming years. On that note, I'll speak with you again soon.
番組の概要欄(原文)
<p>The big 3 AI companies all had serious scandals last month. Anthropic pushed a federal AI bill that would make it harder to stop dangerous model training. OpenAI fired three safety researchers based on evidence that’s somewhere between weak and nonexistent. And it came out that Google DeepMind gets staff to sign contracts barring them from criticising anything Google does for the rest of their lives.</p><p>But these companies are not beyond influence. The track record of holding them to account — staff objecting internally, journalists digging for dirt, campaigners making a fuss — is impressive for how little effort has gone into it.</p><p>Many staff want to do the right thing and can be persuaded on the merits. And the fierce competition for talent forces companies to try to seem like the good guys.</p><p>That’s why being a pain in the ass for the leading AI companies is a legitimate career path, and an underrated one.</p><p>Inside the companies we need even more staff to speak up clearly and visibly with the substantive case for their firms to raise their game.</p><p>And externally we need, among other things:</p><ul><li>Investigators uncovering company misbehaviour and failures</li><li>Subject matter experts laying out the facts for journalists and politicians</li><li>Campaign organisers and social media experts focusing public attention where it’s needed</li></ul><p>Today I lay out what each AI company got wrong this time, why the ability to bring down the immediate hammer of fierce public and expert outrage matters more as events speed up, and the many ways you can contribute to that effort.</p><p>If you want to work on holding AI companies to account, <a href="https://80000hours.org/career-reviews/ai-safety-advocacy/">our career review of AI safety advocacy</a> is a good place to start, <a href="https://80000hours.org/speak-with-us/">our 1–1 advising team</a> can help you think it through, and <a href="https://jobs.80000hours.org/?refinementList%5Btags_area%5D%5B0%5D=AI+safety+%26+policy&jb_source=homepage">our job board</a> lists AI safety and policy roles.</p><p><br><em>This episode was recorded on October 29, 2026.<br></em><br></p><p><a href="https://80k.info/AI-accountability"><strong>Links to learn more, video, and full transcript: https://80k.info/AI-accountability</strong></a><strong></strong></p><p>Chapters:</p><ul><li>We need a stronger effort to push AI companies to do better (00:00:00)</li><li>Anthropic: who gets to pull the brake? (00:01:14)</li><li>OpenAI fires three safety researchers (00:07:14)</li><li>Google DeepMind’s lifelong gag clause (00:12:44)</li><li>Credit where it’s due (00:15:39)</li><li>How to make AI companies behave better (00:16:34)</li><li>Insiders: if you want to stay (00:17:31)</li><li>Insiders: if you’re willing to leave (00:18:40)</li><li>So… should you leave? (00:19:37)</li><li>Outsiders: what’s already worked (00:20:39)</li><li>Outsiders: digging up and explaining (00:22:51)</li><li>Outsiders: reaching the public and politicians (00:25:12)</li><li>Keep the pressure on (00:27:52)</li></ul><p><strong><br></strong><em>Our production team includes:</em></p><ul><li><em>Video editors: Josh Alward, Dominic Armstrong, Jasper Luithlen, Milo McGuire, Luke Monsour, Simon Monsour, Ollie Bignell, and Andrés Escobar</em></li><li><em>Producers: Elizabeth Cox and Nick Stockton</em></li><li><em>Coordination and support: Katy Moore and Lou Moran</em></li><li><em>Camera operator: Dominic Armstrong</em></li></ul>
出典・この記事について
- 番組
- 80,000 Hours Podcast(The 80,000 Hours team)
- 元の回
- Being a pain in the ass to (or in) AI companies is a real job now | Rob Wiblin
- 配信日
- 要約作成日
- 公式サイト
- 80000hours.org/podcast
この要約・解説記事は、元の音声を文字起こしした内容をもとに AI(Claude)が日本語で作成したものです。 固有名詞や数値に誤りを含む場合があるため、正確な内容は元の音声でご確認ください。制作方法について
関連エピソード

Demis Hassabisと AI 開発競争の行方 ― Sebastian Mallaby が語る『The Infinity Machine』
Software Engineering Daily

AIと戦略:ビジネスの優位性を再定義する――マイケル・デイヴィス氏との対話
The Pulse of AI

AIブームは本物か、持続するか――Anthropic S-1、SpaceXのネオクラウド、フロンティアAI規制案
The Data Exchange with Ben Lorica

オープンモデルとサイバーリスクについて、私は間違っていたのか?
Interconnects

AIバブルかどうか、まもなく分かる――Anthropic IPOとS-1が示すもの
Hard Fork

コンピュータが(時に)人間より優れていても構わない
The Stack Overflow Podcast