FigmaのPMは毎日どうAIを使っているか|Ezra Mechaber(FigmaのPM)

How Figma’s PMs actually use AI every day | Ezra Mechaber (PM, Figma)

How I AI42分
FigmaのPMは毎日どうAIを使っているか|Ezra Mechaber(FigmaのPM)

FigmaのPMは毎日どうAIを使っているか|Ezra Mechaber(FigmaのPM)

How I AI

0:0042:29

要約

FigmaのグロースPMであるEzra Mechaberが、Claire Voのインタビューで、社内PM向けの共有リポジトリ「PM OS」(31スキル)を紹介した回。Slackを整理する「what's up」スキル、Codexによるバグバッシュ、実験を自動で回す「AutoXP」、小型高速モデルJevを使ったリアルタイム執筆支援を実演している。最後に、AIに苛立ったときの向き合い方も語られる。

この回のポイント

  • ●PM OSは製品ではなく、agent.md、スキル、起動時フック、フォルダ構成だけの基本的なリポジトリ。親リポジトリと各PM専用のサブリポジトリの二層構造で、60〜70人のPMの同期を保っている。
  • ●最初は3人のPMがPRを大量に出し、スキルが乱立する状態から絞り込んだ。春にはFigmaの全PMが参加するオフサイトで試用し、批評し合った。モデルの進化に合わせて不要なスキルは削っている。
  • ●「what's up」スキルは1日6回ほど実行し、Slackやプロジェクトから返信待ちや未決事項を拾う。ほかに組織図から担当者を探すスキル、成果物を公開するbuild artifact、コーチング、FigJam生成などがある。
  • ●Codexでのバグバッシュでは、テスト手順を書いたFigJamを渡して実行させる。絵文字を1000個入力すると壊れる問題や、チーム名の冠詞(A/An)の不具合など、人が見落とす細かな点を拾った。
  • ●AutoXPはCursor Automationsで動き、データサイエンス、UXライティング、エンジニアのエージェントを連携させる。人間が確認するのは実験の開始前の1回だけで、初回の実験で大きな成果が出たと本人は述べている。
  • ●Jevを使った執筆支援は、入力が止まるたびに空欄(TK)や根拠の薄い主張を検出し、ライブラリのインタビューから裏付けを引く。AIへの苛立ちは自分の指示やコンテキストの汚れが原因のことが多い、という見方も示した。

章立て

  1. PM OS誕生の背景

    社内でエンジニア以外がAIをほとんど使っていないと気づいたEzraが、自分のClaude Code環境を共有リポジトリに発展させた経緯を語る。

  2. PM OSのデモとスキル群

    チーフオブスタッフ設定、担当者検索、Slackを整理する「what's up」スキルを紹介する。

  3. リポジトリ構造と作り方

    agent.md、フック、サブリポジトリの二層構造と、スキルを試して絞り込んだ過程を説明する。

  4. その他のスキルとターミナルからの脱却

    build artifact、FigJam MCP、コーチングのスキルを紹介し、ローカルWebフロントエンドへ移行した経緯を述べる。

  5. Codexでのバグバッシュ

    FigJamの手順書を使い、Codexにブラウザ操作でテストさせる方法と、見つかった不具合の例。

  6. AutoXP:自動グロースPM

    Slack起点で複数エージェントが実験を立案・実装・分析する仕組みと、人間の確認が1回で済む点を説明する。

  7. Jevでリアルタイム執筆支援

    入力が止まるたびに空欄や主張を検出し、ライブラリから根拠を引くプロトタイプを実演する。

  8. ライトニングラウンド

    パーソナルエージェントのInstinctやdots、AIに苛立ったときの接し方を語る。

解説記事

FigmaのグロースPM、Ezra Mechaberが、ホストのClaire Voに社内PM向けの仕組み「PM OS」を紹介した回である。31のスキルを束ねた共有リポジトリを軸に、バグバッシュ、実験の自動化、リアルタイム執筆支援まで、PMがAIで実務を進める具体例が語られた。

「適切な場所で怠ける」ために作ったPM OS

Ezraは入社当初、エンジニア以外で実務にAIを使う人がほぼいないことに驚いたという。そこで自分の生産性を上げるため、Claude Codeの端末環境で自動化を始めた。当時のCPOからは、全PMをAIに慣れさせるには何が必要かという課題が出ていた。同僚のPM2人と、個人の環境を再利用できる形にしたのがPM OSである。

狙いは、PMが苦手なことや手が回らない仕事を「最低限許容できる水準」まで引き上げることだ。サポートチームへの共有漏れを防ぐ、議事録を十分な品質で残す、といった例が挙がった。Ezraはこれを、全体の底上げ(フロアを上げる)と表現している。

製品ではなく、ただのリポジトリ

PM OSは専用のアプリではなく、基本的なリポジトリである。agent.mdで振る舞いを定義し、スキルが発動条件と処理を記述する。起動時には新バージョンの有無を確認するフックが動き、60〜70人のPMがおおむね同じ状態を保てる。

構成は二層になっている。全員がダウンロードする親リポジトリと、各自のワークスペースであるサブリポジトリだ。書き戻したい内容は自分専用の側に保存できる。当時はUIがなく、GitHubを触ったことのないPMにも使わせる工夫が必要だったという。

作り方も特徴的だ。3人でPRを大量に出してスキルが乱立した後、絞り込んだ。春には全PMのオフサイトで実際に使い、批評してもらった。利用状況の計測は、監視されていると感じさせたくないことと時間の都合から入れていない。モデルが賢くなるにつれ、不要になったスキルを削っているとも述べている。

日常で使うスキルの例

中心の一つが「what's up」で、1日に6回ほど実行する。重要なSlackチャンネルのスレッドを読み、返信すべき相手や未決の判断をまとめる。実行中の実験を一覧する版もある。ほかに、約2,000人の組織でコードオーナーや関係者を探すスキルがあり、ドキュメント作成時にレビュー担当を自動で追加する。

build artifactはHTMLの成果物を社内ホスティングで公開するスキル、FigJam MCPを使ったワークショップテンプレート生成もある。コーチングのスキルは、キャリアラダーやフィードバックを踏まえて助言する。Claireは、実務的なものから対人、生成系までそろった構成だと評した。

なお、端末での利用は本来の終着点ではないとEzraは考えている。文章を多く書くPMには等幅フォントが読みにくいため、ローカルで動くWebフロントエンドを作り、モバイルでも動くようにした。現在は自身はほぼCodexに移っている。

Codexによるバグバッシュと自動実験AutoXP

バグバッシュでは、テスト用アカウント、辿る経路、見るべき点を書いたFigJamをCodexに渡し、ブラウザ操作で実行させる。結果はFigJamに書き戻される。Ezraによると、1000個の絵文字を入力すると壊れる問題や、チーム名が「A」で始まると冠詞を「An」にすべき表示の不具合が見つかった。自分では気づけなかった細部をAIが拾った例だ。

AutoXPは、未使用のトラフィックを無駄にしたくないというグロースPMの発想から生まれた。Cursor Automationsで3つの自動化がSlackをきっかけに動き、データサイエンスのエージェントが離脱やファネルを分析し、UXライティングのエージェントが文言案を出し、エンジニアのエージェントがPRを作る。人間が見るのは、データ分析、仮説、文言、コードをまとめて確認する開始前の1回だけで、終了後は分析がWebhookで自動起動する。初回の実験で大きな成果が出たといい、現在は5本が並行して動いている。ただしEzra自身は、理論上は優れているが実際にはほぼ到達という段階だと認めている。

Jevによるリアルタイム執筆支援

Jevは、複雑な問いに対して素早く安価に数値などを返す小型モデルとして紹介された。Ezraは、Figma内のエージェントが大型モデルの遅延で同僚のように感じられない点を挙げ、Jevの速さに可能性を見ている。

試作では、入力が止まるたびにJevが文章をチェックする。TKや空欄、根拠が必要な主張を見つけ、ライブラリのインタビューから引用を引いて裏付ける。単なるパターン検出に加え、文章と関連する別の箇所を結びつけられる点に、検索や文書取得(RAG)を想定した設計の強みがあると述べている。

AIに苛立ったとき

ライトニングラウンドでは、メッセージで動くInstinctや、dotsといったパーソナルエージェントの話が出た。AIに声を荒らげるかという質問に、Ezraは「友人のように接する」と答えた。苛立つ原因は多くの場合、自分の指示やコンテキストの汚れにあり、会話が回復不能になったら新しく始めるのが良いという見方だ。Codexで、ローカルからリモートに移したセッションが権限設定を引き継ぎ、承認を何度も求められる不具合にも触れた。

まとめ

日本の読者にとって注目点は、高度なツールを作らなくても、リポジトリとスキル、フックという簡素な構成で数十人規模のPMを揃えられる点だ。底上げを狙い、モデルの進化に合わせてスキルを削る運用は参考になる。AutoXPのように人間の確認点を1回に絞る設計は、実験運用の考え方として示唆に富む。一方でEzra自身も、実用面ではまだ途上と述べている。

文字起こし(英語・自動生成)

I, as a growth PM, I feel like the biggest sin you can commit is wasting traffic. What if we could just automate myself out of a job and like create a little growth PM who could just like run and run and run? I call it AutoXP and right now one of our engineers is running it and has like five different experiments going that I have not taken a look at and it found a huge win on its very first experiment. AutoXP has its own channel where it can communicate with itself, hey, AutoXP, go find an experiment to run on our settings page. See what you can do. Go crazy. And it will trigger a data scientist to go find drop-off and like look at the funnel and look at mix shift and all of those things. The whole hypothesis was like, how do you exploit all this traffic and maximize the number of experiments and then like the time to be alive? It is here. You can just like five code it there. This is amazing. welcome back to how iai i'm claire veau product leader and ai obsessive here on a mission to help you build better with these new tools today i have ezra mccaber product manager at figma and he's

going to show us figma's internal pmos the 31 skills that every product manager at figma uses to make their life a little bit easier we're also going to talk about of course my boy jev and how you can build a real-time AI editor with that little, cheap, fast model. Let's get to it. Optimizely Agent Platform for Marketers is built on a bigger idea, a whole directory of agents now joined by a newly revealed squad of virtual teammates, each with a defined role and a personality of their own. This isn't about faster drafts. It's about handling the coordination, too. The research, the approvals, the handoffs, the routing, the back and forth that quietly eats your week and never makes it into anyone's highlight reel. Get the story behind it all. Hear the confessions from marketers who've handed off the busy work, meet the squad, and understand what virtual teammates can do for you at optimizely.com slash howiai. Ezra, welcome to How I AI. Thanks so much. One of the things I love about this

podcast in particular, because I know we have a lot of crossover listeners to Lenny's podcast, is PMs are really leaning into AI, but they're all doing it in completely different ways, right? I started a gajillion AI years ago with like chat PRD and like how do we make documentation and go really fast. We've seen so many different product flows. I think everybody's sort of crafting their like artisanal product platform now because they can. And so when you said you had a PM OS, I was just so excited to have you come on and demo it. So tell me, what was the origin story of what we're going to see today? And why did you build it? I like to tell my engineers that my goal is to be lazy in the right places. And so for me, a lot of it was I walked into Figma a couple of years ago and I thought everyone was going to be using AI. It was going to be crazy AI pills. I was just going to, I was already feeling behind. Like I just, I felt behind because we're all on Twitter and we all see like, you know,

Tebow just posting about like the future of the universe. And I walked in feeling really behind and I realized basically no one was using these tools outside of engineering to like get real stuff done. And so I started just trying to automate some of my own productivity. Like I was the person who was trying to do too much in zapier like many years ago and the more time i spent with it one cloud code had just come out and i started to realize like there were things i could do in the terminal that were like really interesting all of a sudden i could like build cli we you know we were in that cli phase and like no other pms who i was working with were doing it and they were all sort of curious and we had this really interesting challenge from yuki who was our cpo at the time which was basically like what would it take to get all of our pms kind of ai pill like what would that look like and um working with a couple of other pms um shout out to jenny and lawrence started thinking about like what would it look like to turn this thing that i was doing

just like hunched over my laptop like a little creep into this kind of like reusable thing that lots of other PMs could build on top of. Great. And so what were like the problems that you thought were most important for PMs to think they could solve with AI? First of all, I feel like the like really trite thing about being a PM is that you're doing too many jobs. And the question is like, which jobs do you either do really poorly or not do at all? And so for me, it was like, okay, how do I do for the jobs I'm not doing and the jobs we are not doing as a team, how do we do them at like the minimum allowable level of like missing things like my ir support team is incredible and the thing that i forget to do on every launch is to loop them in at the right time and so one of my questions was like how could i do this to make sure that i don't forget katie one of our support ops people or meeting notes not my friend i'm really bad at them but like we have transcription tools how do i just get like good enough so that i'm not blocking other people so a lot of them

started from my jobs of what I wanted to do find someone in the org who works on such and such thing we're like 2,000 people now so just understanding who the code owner is is really useful um and understand who we are in relationship between the other and then also just like how do I get fun productivity out of all of our other PMs so um one of the skills that's in there was this like really detailed spec skill that started to walk through how does our code base work if you wanted to do this really intensely? Like, if you wanted to do this the right way, what would that look like? Amazing. And so I love this idea that you had a couple tasks on the PM plate that you were like, we need minimum viable doing of these tasks. Like, it just needs to be right. Just making you not bad at it. Yeah. And I talk a lot about you have to, like, both raise the floor. Like, we have to do just a little bit better on our baseline and take off the ceiling. And I think AI can help you do both.

And often you have like one set of people taking off the ceiling and saying, hey, everybody else like take off the ceiling instead of like, this is how I can help you raise the floor. Okay. So show us what PMOS is, its skills, what it does. How are you relying on this day to day? Cool. Okay. So this is the rough structure. It started just as like a really simple repo inside of Cloud Code as a TUI. And so it's got this, you're the PM's chief of staff, you know their work. I hate the term chief of staff, but like it's really useful for like teaching. It's really good shorthand, which makes me die a little bit every time I read this. When the session kicks off, it reads some information about like who the PM is, who they work with. It's got a memory file. And then it's got a couple of different skills that we can walk through. So one of them was just like we had no good data on like which set of people work on X thing.

Like we have several different org chart tools and like none of them are stitched together in useful ways. And so one of them is just like literally who works on this team, who owns X, and it calls it when it writes docs. So if you need review on a doc, you, the PM, do not need to remember to say my my engineering manager is Amin. It just adds all of the relevant people as like Charlotte is my designer and Amin is my engineering manager. And it adds them as the relevant people and remembers who your skips are. So that's skill number one, which was just like a nice way of reducing some of the like repetitive work inside of new docs. I use it a lot as like a meta Slack. So our Slack is insane. I feel like anyone who's in a large enough org in tech, just like Slack becomes really unruly. I archive roughly 10 channels a day it's bananas um and so one of the things that we were really focused on uh was how do you help pms know where to focus and what to do and like go run down all

the things that are important and so I run this skill what's up like six times a day it pulls all of my relevant slacks and projects together it pulls all of the things that I like who I owe stuff to what decisions are outstanding. I have a version of this that runs through all of my live experiments on the platform and gives me a, not that I peek at my, you know, stop listening, not that I peek at my experiments. Say it, say directional. Say directional, I dare you. Right, right. And so I find this thing to be incredibly useful, and let's see if we can find anything. So it will look at certain channels that we've identified as useful, it will read the whole thread this is probably a little over specified like i feel like we're all moving towards like the models are just good enough now but there's a lot of stuff in here about how to find exactly the right stuff for the way that we are all set up in figma um which is just enormously helpful

for how i run my day-to-day as someone who's just in way too many meetings and trying to do too many projects what i like about what you're showing because so many of these like pm os's that we've seen skip all this like foundational piece which is in large organization it is actually really hard to know like who should have an opinion on this product is somebody else working on it and so I like that you invested in sort of like the baseline context gathering as skills and then I'm presuming that helps like level up some of the more like complex or strategic workflows that come on those PMOS. Yeah, it's been a long time. I tried to build a benchmark sort of unsuccessfully. I'm curious how you think about it for all the stuff you're doing now. But like, I would be really curious how this performs relative to like totally vanilla codex these days. But I do think like in general, especially in that early, like, I don't know, like last October through like May as like the models were getting better, but we're not like superpowered

yet felt like it was really really helpful for how it navigated all the weird parts of like Figma IA Yeah And one thing again we actually didn specify this for folks but Product Team OS is a repo right So like take a step back and tell us like what is it? Is it a repo of skills? Yeah. Is there more to it? Like what is actually the thing? Yeah. So it's a really, really basic repo. and so it's got an agent.md which just tells it how to behave it's got a bunch of related skills that tell it when to fire and what to do it's got a couple of command hooks so things like on boot go find out if there's a new version of pmos because we wanted a good way to like keep hour 60 to 70 p.m. kind of roughly in sync. We've also got a couple of built-in folder structures. So the base template when you onboard is this, like, it's a dot folder,

so it's invisible and you can't mess with the context. But then it duplicates and it sort of builds your version out. And then it's technically two Git repos. It's the parent repo that everyone can download, and then their workspace is a sub-repo so that if you want to write stuff back, you can write it back privately. Amazing. Again, because, like, none of this was in a UI at the time, and so we were all just trying to figure out ways to, like, make GitHub work for PMs who had never touched GitHub before. And was there a small group that sort of, like, brainstormed what these initial skills should be? Was it like, hey, everybody just put in their favorites? How did that work? Yeah, so Jenin and Lawrence, I think, talked about this a lot at Config this year because they did a little presentation on this. But basically we had a really small Slack channel of just the three of us hacking away and firing off as many PRs as we could for a little bit. We had that sort of like Cambrian explosion of like a thousand skills and then started to like whittle stuff down. And then we did an offsite with every PM at Figma this spring where we had

everyone install it, use it, hack on it, come up with like what was good, what was bad, just like roast it. And so some of the skills that are in here came out of that. Some of the skills either got whittled down or whittled away. And I would say the models have gotten better. I've been trying to basically take stuff out that's no longer useful. That's great. And so I have a question. Do you have, as a team, any telemetry on this, like how it's being used? Is it instrumented? No. I thought about doing this, and I decided, one, I, like, didn't want anyone to feel creeped. And, like, I wanted it to be fun, and I also just didn't have the time for it because all of this was, you know, like sort of 20% time. um the biggest thing for us was just we like pms of the plaque are chronically online and so we got a lot of feedback and then we had a public channel and so we started getting like all of the engineering managers started using it and asking us if we could like come help them talk about how to do knowledge work for engineering um our data scientists have one that is like essentially a fork

of this um and so we were getting a lot of feedback about what it was good at and what it wasn't good that and i think for us the the big next thing and we can talk about the evolution into what it is today if that's helpful but like mostly for us it was we managed to get a bunch of pms comfortable in the terminal but like surely that's like not the right end state like especially if you're doing a lot of writing it like sucks to read monospace font all the time and so for us like that was where we wanted to spend our time is like okay what what would be next how do we get people out of the terminal now that we're we've got them comfortable to concept well before we go to what's next can you walk us through like just a couple more of your favorite skills in here maybe ones that teams haven't thought of or you think are particularly unique or kind of helpful yeah sure so i do think for us like with a busy slack the this kind of like meta what's up that is tuned to just like literally what do you have to do every day and how do you judge whether you're doing a good job is really useful build artifact is um one of my favorites at the moment which is

if I have something like actually this demo, like dashboard that I made for this podcast is just like a really simple HTML artifact. And then we have the ability to publish it. We've got a little hosting tool that we use internally. And so it takes it through. It's got, in this case, it has a template HTML and I've got a couple, I don't know where they're sitting. I've like totally lost track of my folder structure at this point but um there's like a couple of different templates of little css that i like and i've sort of grabbed from different places um and so build stuff like this when i want to show stuff off fig jam the mcp for figma is insane i don't know if you get to use it on a regular basis but i feel like i use the mcp all the time and one of our pms built this amazing fig jam builder that produces these like wild workshop templates very quickly and so just figuring out like how to load it up with like what do you think looks good

or how do you think it should work and so there's a lot of taste in here on how it's designed there's you can also tell there's like we've got a lot of clod slop in here from earlier i was gonna say that is such a clod slop sentence right there um but it's a mix like there's a lot of stuff in here that like if you look at this output compared to some of the fig gems that we would put together natively internally like it's it's just a really good set over time and then maybe my favorite other one is coaching which i use um as someone who used to manage people and is now i seeing again like i spent a lot of time living your life oh it's so nice it's so good um i used to spend a lot of time thinking about how to coach people and uh you know i feel like managers are very busy especially now and so thinking about like i always wanted to make sure i was doing the first pass of my own coaching before taking it elsewhere and it's just really good at saying like hey here's

our career ladder here's where you are here's all the feedback that i have about you i'm gonna listen to your problem or i'm gonna listen to this thing that you're working through and i'm gonna tell you basically like get over yourself and don't be like don't worry about it and just like keep working on this thing or like learn how to communicate with this person because i remember that the last time you had an experience with this person like you misunderstood them and when you had a conversation about it you understood that you had just misunderstood so i really like it for coaching i think it's really really strong on that one and you have about 30 31 like just looking through the list they seem like both a combination of very tactical yeah interpersonal and then like generative in some ways. That seems to kind of be the catalog of them. Okay, so how do people actually use this? Is this a kind of like app that you built? How are people using this? Yeah, so I think it's been a little bit of a journey. So we started in Claude with the literal TUI in Terminal. We had a lot of debates

about the best Terminal app because people were coming over from UIs. then we built a little front end for it which runs locally and tried to make it really fun it's got like all of the like leak code type ascii art in it and the goal here was just bring it into the web browser so that people could type like we're doing a lot of writing it's hard to read monospace it's got some nice markdown formatting we built it works on mobile i actually like right after this was this was pre-astra but like i spent a bunch of tokens building like a local native version just to like see what it looked like now i'm basically in codex 100 of the time one i think browser use has gotten really good so good really good um we have uh we don't have permanent desks in the new york city office and i don't like thinking about booking a desk every day and so every once in a while I have it running on a schedule to just like book my desk one day out um but it's also it's a total beast at bug bashing and so um like in codex I have a little

bug bash I have like a threaded conversation that just lives here all the time and when something new comes up for our team where we're about to launch an experiment or redesign or something we have these fig jam files that explain here's here's how to bug bash it like here's the test account to take here's the path to follow here are the actions to do and like here are the things to look for and i have started basically snagging one account for me and one account for astra and just having it run through so in this case we are trying to make some of our request models inside of figma just like much more straightforward and much more streamlined it's all ux stuff it's all UX writing it's fairly straightforward but the like logic behind it is really complex and so Astro is just much much more diligent about following directions than I am and so I will run it through and I will say like keep doing all of these specifically and just like it will run through all of these scenarios and it will use the browser and uh it's a dream and then

when it's done it writes out back to the fig jam board of all of the things that it has done and I feel like we are still tuning it so that it is not like annoying in the comments that it drops. But in terms of like what it finds for me, like it found for two things it found in the last month. One, it discovered that if you put a thousand emojis in a text box, it would break, which like weird edge case, great, good to harden. Two, it found that the way we had, you request a seat for a given team inside of Figma, and when you do it, it shows your team name. And we had A, like A quote team name, C. And if your team name starts with A, you need to use Anne. Anne. I'm like, it had just not shown up in our earlier bug bashes because it really depends on what the team name is. And so it was just, it wound up being so diligent that it caught really small nits like that that I would never have caught on my own. This episode is brought to you by Jira Product Discovery.

With AI a single PM can summarize research draft a PRD and build a working prototype But multiplayer mode That broken You can get everyone aligned on what should actually ship with just a markdown file JIRA Product Discovery gives your team one place to capture insights, prioritize with evidence, and build living roadmaps everyone can rally around. And because it's powered by Atlassian's teamwork graph, It has the context you need to decide what to build. Those decisions flow straight into Jira so your developers or coding agents can start building with the context behind every decision. More than 25,000 companies already use Jira Product Discovery. Try it free at Atlassian.com slash HowIAI. That's Atlassian.com slash HowIAI. AI, JIRA product discovery, better product decisions in the AI era. I love that so much.

And so I think this like bug bashing workflow is a really great one. I highly recommend people do this and then keeping track of it in a fig jam or some other sort of like kind of asset is helpful for you to just track what the feedback is. You have another automation that you're using in the team around experiments, right? Yeah. So one of the things that I had been thinking about for a while as our models have gotten better is like, what are all of the different ways that we can improve cadence? And so like I, as a growth PM, I feel like the biggest sin you can commit is wasting traffic, right? To like have unallocated traffic that is not running towards an experiment at any given time. It's like, why are you wasting that traffic? And so thinking about ways that we could run an experiment on a surface we would never have spent time doing normally was really, really interesting to me. And then the models were just getting good enough across a little bit of engineering, a little bit of data science. The user experience writing was not so bad.

The ability to come up within a really bounded sandbox was getting better. And so I started thinking about, like, what if we could just automate myself out of a job? and create a little growth PM who could just run and run and run. And there's been a couple of other folks who have done this. I think some of the folks at both labs have done it, which is where a bunch of this inspiration came from. But I realized that internally we finally had all the tools, and so I call it Auto XP. And right now one of our engineers is running it and has like five different experiments going that I have not taken a look at, and it found a huge win on its very first experiment. And basically the way that it works is this. You can see this is like one of the fancy schmancy artifacts that we made for this. It works as a cursor automation. So there are three cursor automations that trigger based on stuff in Slack. AutoXP has its own channel where it can communicate with itself.

someone can either tee up an experiment in the Slack channel or they can, or it can just like run on a loop. So one of the things you can do is just say, hey, AutoXP, go find an experiment to run on our settings page. See what you can do. Go crazy. And it will trigger a data scientist to go find, or data scientist agent to go find, to go find drop-off and like look at the funnel and look at mix shift and all those things. it will trigger a UX writing agent that will come up with some ideas for copy in a given place. We're like moving towards more front end design now. And then lastly, it'll trigger an engineer that'll pick up a PR and run it. And then again, with all of these steps, it writes back to the Slack channel in the same thread. So you can follow over the course of the experiment, basically like what's happening. And there are two things that I think it does here that are really amazing. one of which is we are able to run experiments in places we would never have bothered to dedicate time or traffic

way faster to get from I have an idea to this experiment is launched. And then two, when it's done and an experiment finishes, it triggers essentially a webhook back to the original experiment to say, hey, it's time to analyze these results. and it has a bunch of instructions from all of the time that I have spent as a growth PM to figure out like do we want to explore more do we want to try to exploit is this a win is this a loss and the goal for all of this is the only time you're allowed to look is before you launch the experiment so you review the data science findings the hypotheses the ux writing and the code all at once so like one human touch and then it launches and then you can review whether or not it's a win or a loss, but it has already started data rating on the next rounds. I would say like where we are in theory is pretty like is great. Where we are in practice is almost there. And so one of our engineers, Marianne, has been taking this really, really far. But we're now at like five live

concurrent experiments on things that we would not have been doing otherwise. So this is a little bit of Clairvaux lore, but for those that are new to me, I have worked at every experimentation platform company in history and did a startup literally 13 years ago, something like that, called Experiment Engine. And the whole hypothesis was like, how do you get, how do you exploit all this traffic and maximize the number of experiments? And then like, what a time to be alive. It is here. You can just like vibe code it there. This is amazing. Okay. I want to show one last thing, which is my boy, Jeff. and we have been doing a lot of Jev. Poor one out for Jev. Poor, I don't know. I think Jev's got a real shot at some longevity here. You have high-pitched use. But you have something really cool with Jev that I want you to show, because it's a use case I haven't seen. Yeah, totally. So, right, so for people who don't know, though how could you not know?

I feel like if you're listening to How I AI right now, Jev is this model where you can ask it really weird, complex questions in text, And you get like, especially a number back, right? So like, how good is this on a scale of one to 10? Or is this true or false? Or like, what is the meaning of life? Is it A, B, or C? And it's really fast and it's really cheap. And so I started thinking about all of the different places we could shove this that would really change the way that people work, right? So if you've used Figma has an agent on the design canvas, I adore it. It's really, really good. but it is still subject to all of the latency that you get with all of these top tier models, which is like it's slow in places where you want to have a coworker and it doesn't feel like a coworker. And so as we work on that, Jev feels like really, really interesting for some of those possibilities. And one of the first things I was thinking about was this idea of like, what if it could run questions about things you were writing as you were doing it? Like, what if it could know

that you needed to, if you've ever written a blog post and had a section where you aren't sure what's going to go there, maybe you write TK or you leave some brackets. And sure, you could do that like totally programmatically of just like look for and identify. But also maybe you have a claim that you're not sure like you have data for or you need to go look up in your notes later. And so I basically I built this prototype. I'm going to forget the name of it, but there's I I think it's called Marker, which is this beautiful looking writing app from this guy, John Steindach, which is an incredible name for a guy who runs a writing company. They have some of these ideas around it. And so as I was just playing with like what could be possible with Jev, that was kind of one of the inspirations here. And I wanted to have Jev basically make a call to Jev anytime I stopped typing. And so the thing that it does is when you stop typing, it will look for places where you've left blanks or claims we're supporting.

And it will use stuff in your library to go ahead and actually like substantiate those claims. So in this case, like I said, most people find it easier to keep writing than to stop and look something up. And it's making a call here as soon as I stopped writing it into the library where it has all of these interviews about like what these people actually did. Like if I go hunting for a number, I forget the sentence I was trying to write. We recently put the API behind our own internal firewall. So let me see if I can actually run it live or if it's going to get mad. uh okay i made hot dog oh no hold on but it doesn't actually want to is it blocking it what is blocking it i don't know it impressed me it did something fast right okay so i just want to like reiterate this for people because it is mind-blowing which is as you write as soon

as you stop for a minute it runs a quick dev check which is very very fast and says like does something need to be filled in does something need to be supported like what questions do i have about what you're writing and then like hooks up to data sources and actually helps you improve your writing as you add stuff jev right okay so this network so you've got um here you've got your title so this is my title and as soon as i stop it's going to start checking things so maybe i've got, I was thinking about how we serve writers, and I thought, TK, great. And it's like, you had a thought that you didn't finish. But then you'll see, like, it also ran a check, and it said, I have no idea what you were thinking, because it's not in this library. But then I could say something like, we spoke with ex-writers, and they said, and it both knows that I need to finish this, and it went and pulled from the library like literal interview quotes from like writers we allegedly spoke to for this

blew my mind I went like this you rarely get one of these at How I I a full Claire hands up It's so cool I just all for literally for like two weeks after Jeb dropped I was just like running around going like okay but like can we talk about jev like it was every meeting i was in my engineers some of them were very excited about this some were maybe like a little eye-rolly about it but it's just it's such a cool idea because i think you can imagine all of the different ways that if you could run checks on things at any given time like what you would do with it and i the The thing that sort of blew my mind was that they had built it for RAG or for essentially for like search and document retrieval as well. And so the ability not just to say like this looks like a pattern. I am confident that this you left something. But also I took this block of text and it relates to this section over here and I did it in real time is just like it's kind of incredible.

It's unbelievable. This this podcast is now how I have just it did. I did have this really bleak thought, which is it made me wonder if, like, you could imagine you're interviewing for a PM job and you, like, yap your entire career into something. And then you have a voice to text that is just, like, searching against, like, what your examples are. And I did have this fear because I run a lot of product sense interviews that I was going to start running into people who were, like, jetting their own little helpers, which, I don't know, maybe I should hire them if they do. That's great. Yeah, hire them. I was like, great. Sign me up. Ezra, this has been so good. Okay, we're going to get to lightning round. I just, to reiterate for folks, what do we see? PMOS with 31 skills, including what's up, what do I have going on today, find me people in the org, write specs, coach me, the whole thing. You basically are now using that through Codex entirely, also because Codex is magical for browser use. and then he built a real-time

JEV editor, author, writing tool that you're afraid is going to cause you trouble in future PM interviews or impress you in future PM interviews. So many good workflows in this. So the folks that have stuck with us this long, you have gotten some good stuff. Quick lightning round questions and then I will get you out of here. One, you told me a couple weeks ago you were using Instinct. Are we still on Instinct? What are we doing with our personal agent? Okay, so I still get texts from Instinct and I don't respond. I know the way it works. So for people who don't know, Instinct is this really sort of beautiful idea. Like I'm really into it, which is this idea that what if you had a proactive agent, but instead of like needing a website to visit or an app to use, it just like texts you in iMessage. And I will say I still use it every once in a while. it was this kind of magical thing at the beginning where it was proactive in the right ways

and this like concept of memory that was like useful in this kind of mind-blowing way and i suspect there's a bunch of people who have been running open call for months who are like what's the big deal but it just it productized this really nice experience in a way that was really great and for the first few weeks you could buy things on amazon with it um which while not like a killer use case was really nice because i would just walk around the house and i would say hey siri tell instinct that i need to buy paper towels or like my current use case is i'd bike my kids around brooklyn and i will run into potholes all the time and uh now you can like you can 311 like a fix my pothole and i never remember to do it on time because like you have to look at the address of where it is you have to report it and the website is kind of trash and so I have started like, Hey Siri, text instinct. There's a pothole at like two 69 Atlantic. And it just remembers like what it's supposed to go do and submits it.

So I do use it for that. And it's amazing for that. But I've mostly switched over to dots now that I'm like fully codex built. I, I, I, so I, um, I'm trying to make dots. You're like, you're like rock and youth. Is that right? I'm like max codex maxing. I love codex. You can rip Codex out of my cold, dead fingers. But for work, I'm all grok. Yeah. And then for person, you should check out Muse. It's a real delight. I can't bring myself to do it. I know. But they've been stealing our data for two decades, you know? I know. I know. That's my – as I say to people, the devil I know. This is really where I'm at. Totally, yeah. They already have the data. Okay. I said – my joke is my Instagram ads will get better. I'll end up spending more money. I think this is like a real value prop. Okay, and then my last question for you, when your dot is being obstinate, your AI is not giving you what you want, are you a yaller?

No, no, I'm not. I think we should all be nice to our AI. I treat my AIs like a friend that you love who's really, like, messing it up. You know, you're like, buddy, like get your life together. Like you're too old. That is how I treat. So hold on. I will show you because I yelled at my dot twice today, but I did it very friendly. Okay. So I ordered some shoes. They were too big. I need a half size down. And I tried to like find it the cheapest version. And it was like email searches temporary rate limited. Can you go search your email? And I was like, I don't know, man. That's what I needed you for. um and then uh it gave me some like really expensive stuff and i thought maybe it was being lazy and so i just said like yike assume you aren't going to check this and i i was trying to figure out why i don't yell and i think partially like you can ask that's my wife um i

am like mostly not a yeller but i also think someone posted this on twitter recently and i it really expresses how I feel, which is not that I have some, for people who don't know, there's like this idea of like, what is it, basilisks? Like this idea that if you're mean to AI, but then it turns out they're alive, like wouldn't it have just been easier to be nice? Like isn't that cheaper than like getting turned into a paperclip? And I don't think they're conscious. I don't think they're approaching conscious. But I do think it's really bad for the soul to just be mean to things all the time. Like in the same way that you like, like there's just no reason. Like it's just, I feel like I get worse when I like yell at things that can't help it, even though I don't think it's conscious. You know, I like used to be a very hardcore not yeller. And I'm not like, I'm not mean. I wouldn't say, I'm not saying he's nasty. But I am a very, I'm like all caps, like why? Like why, why are you like this? Why don't you do this to me? And here's, and here's why I'll say this.

I'm spending thousands and thousands, if not tens of thousands of dollars on LLMs. Yeah. Like, why are you like this after, like, $2,000 of wasted tokens? Yeah. That's, like, a cheap. But that doesn't strike me as that mean. Yeah. You know, like, I have, you know, there's, like, there's some real, like, road rage. Like, nasty kind of stuff. Yeah. No, I'm just expressive. Yeah. I think that I will say my take is that normally what I want to yell at AI, it's because I have given it poor instruction. This is how you know I have kids is like there's so much of that, which is like when you get a bad result, the odds that you have like poisoned the context and asked a bad question is like pretty high. And so I will occasionally find myself in loops. the codex has this codex if you're listening opening iteam if you're listening has this really bad bug right now where if you start a local session and you kick it to a remote session

even if you have yolo mode enabled on your remote session it inherits the sandbox with ask permission every time and so i wind up in like clicking approval hell and i get so mad and i go around in loops for a little while where i'm like we already fixed it like you have permission I'm looking at the file. I pulled up the file. We're looking at the config.tom altogether. Like, what are we doing? And usually the answer is like, the context displays in that conversation. It's unrecoverable. And yelling at it is not going to help. So start a new career. Just move on with your life, which is not satisfying. Let me give you a TikTok parenting tip. If you want to, like, really devastate your AI by being a kind parent, which is I know that you're capable, but you're not. Oh, yeah. You're not showing me how capable you are right now, and that's just signaling to me I need to be a better parent. Okay, I love that.

One, stealing the parenting tip. Two, stealing it for AI. I feel like I really love to give my AIs big expectations, and I feel like it's not in the math proof, but I have been doing a version of this which is like, buddy, I know you can cook. Like, you would not believe the things that I've seen out there that you are capable of. Like, if you try a little bit harder, I am sure that we can vibe code this prototype that I can show my engineers so that we can build it. Like, I know this is in your capabilities. I know you can vibe code Salesforce just a little bit more. Okay, Ezra, this has been so fun. So many good use cases. So many good thoughts. Where can we find you and how can we be helpful? Yeah. Yeah, mostly on Twitter. I post too much. Ezra McCaber. And then in terms of being helpful, we're hiring PMs. We're hiring a lot of PMs, and we're hiring a lot of different – if you're an engineer or a designer, we are hiring. Come work at Figma.

It is the most fun I've ever had in a job. We're building really cool things, and the people are great. Amazing. Cannot end it better than that. Ezra, thanks for joining How AI. Thanks, Claire. Bye. Thanks so much for watching. If you enjoyed the show, please like and subscribe here on YouTube or even better, leave us a comment with your thoughts. You can also find this podcast on Apple Podcasts, Spotify or your favorite podcast app. Please consider leaving us a rating and review, which will help others find the show. You can see all our episodes and learn more about the show at howiaipod.com. See you next time.

番組の概要欄(原文)

<p><strong>Ezra Mechaber</strong> is a growth product manager at Figma whose goal is to be “lazy in the right places.” When he joined Figma, he found almost no one outside engineering using AI to get real work done, so he and a couple of fellow PMs turned his personal Claude Code setup into PM OS, a shared repo of 31 skills that every PM at Figma now uses. In this episode, Ezra walks me through his favorite skills, how he bug bashes with Codex, AutoXP—an automated growth PM that found a huge win on its very first experiment—and a real-time writing assistant he built with Jev.</p><p><br></p><p><strong>What you’ll learn:</strong></p><ol><li>Why PM OS is a repo, not a product</li><li>The skill Ezra runs six times a day to tame Slack</li><li>How one repo keeps 60 to 70 PMs in sync</li><li>Why his bug-bash agent catches things he never would</li><li>How AutoXP runs experiments with one human checkpoint</li><li>Why Jev took over every meeting he was in for two weeks</li><li>What to do when you want to yell at your AI</li></ol><p>—</p><p><strong>Brought to you by:</strong></p><p><a href="https://www.optimizely.com/howIAI"><strong>Optimizely</strong></a>—Your AI agent orchestration platform for marketing and digital teams</p><p><a href="https://atlassian.com/howiai"><strong>Jira Product Discovery</strong></a>—Prioritize with insights, build with confidence</p><p>—</p><p><strong>In this episode, we cover:</strong></p><p>(00:00) Episode preview</p><p>(00:51) Introduction to Ezra Mechaber</p><p>(02:04) The origin story of Figma’s PM OS</p><p>(06:30) PM OS demo: the “chief of staff” setup</p><p>(10:28) How the repo works: skills, hooks, and private sub-repos</p><p>(12:00) How the skills got built, roasted, and whittled down</p><p>(14:15) Build artifact, FigJam MCP, and coaching skills</p><p>(17:33) Transitioning from the terminal to a local web front end</p><p>(19:30) Bug bashing with Codex</p><p>(22:08) AutoXP: an automated growth PM</p><p>(26:26) Claire’s Experiment Engine backstory</p><p>(26:58) Building a real-time writing assistant with Jev</p><p>(33:15) Lightning round and final thoughts</p><p>—</p><p><strong>Tools referenced:</strong></p><p>• Figma: <a href="https://www.figma.com/">https://www.figma.com/</a></p><p>• FigJam: <a href="https://www.figma.com/figjam/">https://www.figma.com/figjam/</a></p><p>• Figma MCP server: <a href="https://developers.figma.com/docs/figma-mcp-server/">https://developers.figma.com/docs/figma-mcp-server/</a></p><p>• Claude Code: <a href="https://www.claude.com/product/claude-code">https://www.claude.com/product/claude-code</a></p><p>• Codex: <a href="https://openai.com/codex/">https://openai.com/codex/</a></p><p>• Cursor Automations: <a href="https://cursor.com/docs/cloud-agent/automations">https://cursor.com/docs/cloud-agent/automations</a></p><p>• Jev: <a href="https://typesafe.ai/">https://typesafe.ai/</a></p><p>• Marker: <a href="https://marker.page/">https://marker.page/</a></p><p>• Instinct: <a href="https://instinct.com/">https://instinct.com/</a></p><p>• Dots: <a href="https://openai.com/index/introducing-dots/">https://openai.com/index/introducing-dots/</a></p><p>—</p><p><strong>Other reference:</strong></p><p>• Jev for beginners: how to use it and what to build: <a href="https://www.lennysnewsletter.com/p/jev-for-beginners-how-to-use-it-and">https://www.lennysnewsletter.com/p/jev-for-beginners-how-to-use-it-and</a></p><p>—</p><p><strong>Where to find Ezra Mechaber:</strong></p><p>X: <a href="https://x.com/ezramechaber">https://x.com/ezramechaber</a></p><p>LinkedIn: <a href="https://www.linkedin.com/in/ezra-mechaber">https://www.linkedin.com/in/ezra-mechaber</a></p><p>Website: <a href="https://ezramechaber.com/">https://ezramechaber.com/</a></p><p>—</p><p><strong>Where to find Claire Vo:</strong></p><p>ChatPRD: <a href="https://www.chatprd.ai/">https://www.chatprd.ai/</a></p><p>Website: <a href="https://clairevo.com/">https://clairevo.com/</a></p><p>LinkedIn: <a href="https://www.linkedin.com/in/clairevo/">https://www.linkedin.com/in/clairevo/</a></p><p>X: <a href="https://x.com/clairevo">https://x.com/clairevo</a></p><p>—</p><p>Production and marketing by <a href="https://penname.co/">https://penname.co/</a>. For inquiries about sponsoring the podcast, email jordan@penname.co.</p>

出典・この記事について

番組
How I AI(Claire Vo)
元の回
How Figma’s PMs actually use AI every day | Ezra Mechaber (PM, Figma)
配信日
要約作成日
公式サイト
podcasters.spotify.com/pod/show/pen-name

この要約・解説記事は、元の音声を文字起こしした内容をもとに AI(Claude)が日本語で作成したものです。 固有名詞や数値に誤りを含む場合があるため、正確な内容は元の音声でご確認ください。制作方法について

X でシェアApple Podcasts で聴く

関連エピソード