
Fortune 2000のためのAI――Tenexが築くAIネイティブなSDLC(Alex Lieberman & CJ Hess)
AI for the Fortune 2000: How Tenex Builds an AI-Native SDLC — Alex Lieberman & CJ Hess

Fortune 2000のためのAI――Tenexが築くAIネイティブなSDLC(Alex Lieberman & CJ Hess)
Latent Space: The AI Engineer Podcast
要約
Latent SpaceのAI Engineer New York会場で、Tenexの共同創業者Alex LiebermanとCJ Hessがswyxと対談した回。成果ベースで報酬を支払うエンジニア組織の実態、リポジトリに文脈を残す「MetaHarness」、企業のAI導入の進捗、バーティカルAIやSaaS置き換えの是非、雇用への影響、ニューヨークのAI界隈まで幅広く語られた。
この回のポイント
- ●Tenexはストーリーポイントに基づく成果報酬でエンジニアに支払い、最高と最低の報酬差は約4倍だと述べている。コーディング以外の時間の報酬設計が課題という。
- ●MetaHarnessは、計画書や意思決定ログをリポジトリにチェックインし、CLIでエージェントを動かす仕組み。文脈を人の頭ではなくリポジトリに残すのが狙い。
- ●エンジニア1人あたりの出力は今年おおむね2倍になったと述べ、ストーリーポイントの基準も四半期ごとに見直している。
- ●Alexは大企業のAI導入の到達率を、汎用LLM展開90%、研修60%、コーディングエージェント約50%、非エンジニア業務の本番エージェント5%と整理した。
- ●AlexとCJはバーティカルAIに概ね弱気で、一対一の個別対応を求められる点と、フロンティアモデルに飲み込まれる点を懸念材料に挙げた。
- ●「自動化できるのは存在するプロセスだけ」として、エージェント導入の前に業務の標準化が必要だと強調した。
章立て
Tenexの事業と成果報酬モデル
企業をAI不在からAIネイティブへ導くTenexの紹介と、CJが入社した理由、ストーリーポイントでの報酬設計について。
MetaHarnessと生産性の変化
計画書やログをリポジトリに残す開発プロセスと、エンジニアの出力が約2倍になったという実感、ポイント基準の再調整。
モデル選択とトークン費用
Opus 5.5中心の使い分け、AMPやCodexの併用、トークン支出と費用が下がっていく見通し。
企業AI導入の格差
汎用LLM、研修、コーディングエージェント、非エンジニア業務へのエージェントと続く各段階の到達率、権限管理の難しさ。
バーティカルAIとSaaSの行方
HarveyやOpenEvidenceなどへの見方、Bloombergの例、Kill My SaaSの実験と企業が内製しにくい理由。
AIと雇用
業務の再配分と個人の主体性、再スキル化の責任についての議論。
ニューヨークのAI界隈と採用
SFとの違い、ニューヨークをAIの拠点にする狙い、Tenexの採用募集。
解説記事
AI Engineer New Yorkの会場で、Tenexの共同創業者Alex Liebermanと、特別プロジェクトを率いるCJ Hessが、Latent Spaceのswyxと対談した。Tenexは大企業を「AI不在からAIネイティブへ」導く応用AIパートナーで、成果で報酬を決めるエンジニア組織としても知られる。本稿ではその議論の要点を整理する。
成果で払うエンジニア組織
Tenexは約18か月前、AI活用のコーディング受託会社として出発した。顧客がFortune 2000や売上1億〜5億ドルの中堅企業へ広がるにつれ、依頼は人員提供からAI変革全体の支援へ変わったという。現在は75人で、9割がエンジニアかAIストラテジスト(技術系コンサルタント)と説明している。
報酬はストーリーポイント(作業量の見積もり単位)に基づく。懸念されがちな「ポイントの水増し」や「低品質なコード」は、顧客維持と成長で評価されるストラテジストが牽制するため問題にならなかったとAlexは述べる。報酬の最高と最低の差は約4倍だという。むしろ課題は、設計や顧客との打ち合わせなど、コードを書かない時間をどう報いるかだと語った。CJは、モデルが適切な文脈を与えれば解の9割まで到達できるようになり、顧客の話を聞いて文脈を整理する価値が高まっていると見ている。
MetaHarnessと生産性
MetaHarnessは、リポジトリ内の構造化された文書群と、モデルがそれを使って作業を進めるCLIで構成される。基準となる計画書があり、エージェントが決定や作業内容を所定の方法でログに残し、すべてチェックインされる。CJは、コードだけでなく「なぜその決定をしたか」の文脈も必要で、それが人の頭ではなくリポジトリにあることがエージェントの力になると述べる。モデルの進化に合わせ、構造の強制は減らしているという。
効果の指標は、エンジニア1人あたりの月間平均ストーリーポイントだ。2人は今年の出力がおおむね2倍になったと話す。ポイントの価値が変わらないかというswyxの問いには、四半期に一度は基準を見直していると答えた。
モデル選択とコスト
チームの主力はOpus 5.5で、速く安く幅広い用途に対応できるという。レビューにはCodexを併用し、往復させる運用が最も良い結果になると述べている。CJはAMPのクラウド環境を愛用しているとも語った。
トークン費用については、一時期は高価なモデルが主流でトークン消費を競う風潮もあったが、現在はコストが下がっているという。Alexは、競争激化でトークン単価が下がり、タスク単位のコストも低下しているため、浪費による危険は半年前ほどではないという見方を示した。表計算のセルを動かすのに10倍賢いモデルが要るのか、という問いも投げかけている。
企業のAI導入ギャップ
Alexは企業のAI導入を段階的なマイルストーンに見立てた。彼が話した約100社のうち、汎用LLM(ClaudeやCodex)の展開済みは約90%、使い方の研修は約60%、エンジニア組織へのコーディングエージェント展開は約50%である。さらに、従業員1000人超の企業で、ソフトウェア開発以外の業務を担うエージェントを本番運用しているのは約5%にとどまるという。
背景として、FOMO(取り残される恐れ)による流行追随、データ閲覧権限(RBAC)管理の混乱を挙げた。Tenexは個別開発したゲートウェイを製品化したと説明している。CJは「存在しないプロセスは自動化できない」と述べ、担当者ごとにやり方が違う業務は、まず標準化しないとエージェントの出来を評価するevalも作れないと指摘した。
バーティカルAIとSaaSの未来
AlexとCJは、法務のHarveyや医療のOpenEvidenceのようなバーティカルAIに概ね弱気だと述べた。顧客が一対一の個別対応を求める以上、ソフトウェア並みの利益率は難しく、フロンティアモデルに飲み込まれる恐れもあるという。これに対しswyxは、独自データや専用UI、Bloombergのような利用者習慣という堀があると反論し、2人も市場全体は拡大すると認めた。CJは、ワークフローを変えてエージェントを載せるアプリ型の製品なら成功しうると述べた。
swyxが紹介したKill My SaaSでは、年4万ドルの中堅SaaSを約1000ドルで置き換えた。これに対し2人は、大企業が基幹システムを置き換えるリスクは大きく、中堅SaaSでも内製の維持負担に見合う規模かが判断基準になると述べた。Tenexも自社でCRMなどを内製したが、運用の手間という課題に気づいたという。
雇用とニューヨーク
雇用について2人は、AIは仕事を変え、置き換える面もあるが、コールセンターのように影響が大きい職種もあると認めた。一方で、自動化で空いた人材を別の課題へ再配置する発想が重要だとし、個人にも再スキル化の主体性が必要だと語った。ニューヨークは、SFよりAIのバブルは小さいが商業的な価値は大きいとし、拠点として育てる狙いを示した。
まとめ
日本の読者にとって注目点は三つある。第一に、成果報酬とリポジトリへの文脈蓄積という、エージェント前提の開発運営の具体例。第二に、大企業でも非エンジニア業務のエージェントはまだ約5%という見立てで、導入前の業務標準化と権限管理が鍵になるという示唆。第三に、バーティカルAIやSaaS置き換えへの慎重論である。いずれも本人たちの見解であり、議論の余地はあるが、現場から見たAI導入の課題を知る材料になる。
文字起こし(英語・自動生成)
and I just felt my output getting better and faster and ultimately getting paid less. Like I was charging hourly to my clients. I phrase it to the team as like, you can't automate a process that does not exist. Okay, we're here at AI Engineer checking with 10X. Welcome back, Alex. Thanks. Thanks for having us. You brought your director of engineering, CJ. Welcome to the pod. Special projects lead at 10X. Okay, special projects lead. All right, you're the SWAT team. Yes, yes. So you've been on the pod before, and people are vaguely familiar with the 10X story, but can you sort of reintroduce from the top what is the 2026, how you introduce yourself? Yeah, very simply, 10X is an applied AI partner for some of the biggest companies in the world to help them go from AI absent to AI native. Our belief is that AI is incredible, but it is raw intelligence,
and the hardest problem to solve is the final mile to actually diffuse it through the economy. And so our view is to act as the player to help enterprises to figure all this. Can I curse on? To figure all this shit out. Yeah, yeah. Yeah, we have the explicit tag on Apple Podcasts. Although I did recently discover that YouTube doesn't like it. Oh, really? It's so, like, yeah, you can't see the F word. So did I just mess up your video? What are you going to do? I don't care. Okay. We're adults. CJ, what drew you to 10X? So I was actually the first hire. I don't even know if Alex and Armand had the name 10X quite yet, but I have, like, a graveyard of startups I tried to start before 10X, ultimately culminating in, like, my own kind of engineering consulting company. And I spent some time there doing traditional engineering, eventually moved over to doing some of this like AI consulting and just like building more and more with it. I'm a software engineer by trade. And I just felt my output getting better and faster and ultimately getting paid less.
Like I was charging hourly to my clients. And I really liked kind of the ethos of 10x that Alex had first posted when I saw it on Twitter about kind of looking to reward engineers for their output as opposed to rewarding them for their time. I think, you know, fast forwarding two years, you can see, like, how engineers can now parallelize a ton of work and just have a ton more output. At the time with, you know, Sonnet 3.5, Gemini 2.5 Pro, it might not have been that obvious. But I basically took the bet that I think with my skill set and leaning more into AI, I could have much higher output and ultimately have like a higher earning capacity to do that. And since then I've just like fell in love with that model. I think that's like what the future of engineering really looks like. And ultimately when AI is solving all these tech problems, companies are going to pay based on outcome and they're not going to want to pay based on the time that's required to build something. Yeah, so for more detail on that, people can refer back to our previous pod
where you literally pay people by story points. Yep. And you just have to view what the story points are. But that also means that some 10x engineers can literally make millions of dollars a year, and some others may not make as much just because they're not as productive. Yeah, exactly. Like the thesis is that AI is really just a leveraged bet on a human's intellect and work ethic. And so you're just going to have more variance than ever before in earning capacity. And our view is our model isn't for everyone, but for the person who basically wants to go along themselves, who has this incredible foundation in software engineering, but also is constantly pushing themselves to leverage the frontier to stretch their time as much as possible while having quality output, there's no better way to earn. What's the state of, like, last time I talked to you, I think you had, like, maybe two or three people making a million a year or over a million a year. Is there an update on that? Yeah, yeah, yeah. So just to paint a picture, we started 10X 18 months ago when we started the business. Really, we started as, like, an AI-powered dev shop. Really, like, the original idea was engineering is kind of like the canary in the coal mine for AI.
And part of the impetus was my co-founder, Armand, who's technical by trade, was, like, starting to use coding agents a lot. And then he had some people he knew that were still typing into their ID, like, not adopting the technology at all. And so we're like, why don't we just supercharge a company's engineering org who isn't adopting this? So we started there. Then as we started moving up market from startups and like mid-market companies to now, you know, 50% of our customers are Fortune 2000 and then 50% are mid-market doing $100 to $500 million in revenue. They weren't just asking for basically staff log in AI engineering. They were asking for like AI transformation as a service. Today, the business is at 75 people. 90% of those employees are either engineers or AI strategists, which are basically think of as like technical consultants. And I think the thesis has proved out true, which is there's a very wide dispersion in earning capacity between the highest paid engineer at 10X and the lowest paid engineer at 10X.
It's probably something around 4X difference. Oh, not 10X? Not 10X difference, yeah. That's the dream. Yeah, exactly. But everything is proved right about the thesis. I do think, like, there's been interesting learnings around our model of paying based on story points, where there are limits to the model that we knew would be limits and how we think about that moving forward. But overall, I think the concerns that people had around this model of, like, paying people based on output, like the classic concerns are, well, story points are subjective. People are going to either sandbag story points or they're just going to ship a bunch of bad code. Like barely check the box. Exactly. Right? But not actually do the job. Yeah, exactly. And I would say those two concerns have not been concerns at all because of our AI strategists. We incentivize, I think, perfectly at odds with engineers where AI strategists are incentivized for, like, customer retention and growth. actually the biggest challenge has been how do you compensate engineers for all the time
that's not spent coding, whether it's architecting, meeting with clients, and so that's where we've had to find nuance in the comp model, but it's still largely driven based on output. Anything to add? Yeah, on that, I spent a lot of time thinking about this because if I think about my tenure at 10X, I was coding a lot, coding a lot, coding a little less, and now we're kind of getting to the point where the models are more or less given the right context and can get you to 90% of the solution. And I do think there is some opportunity here to think about, like, really the value is sitting down with the customer, hearing everything that they can brain dump, and then just providing that to the model to actually get closer to the solution. So I imagine, you know, in the future, we're going to start to look more at, like, true what this output is, how it works, how it looks, as opposed to, you know, kind of that traditional story point model, but still anchoring to those as the unit. I think one thing you'd also, I don't know if we've
talked about this before, but like the, this idea of like the meta harness, which is like the, the engineering workflows at 10 X that we use that has allowed us to do, I think like really meaningful work on long running tasks. Do you want to just talk through like what our process is? Cause I feel like people will find that interesting. Yeah. So we basically started trying to kind of standardize a set of skills. I think most engineering orgs have done something similar by this point. And for us, that grew into what is actually, like, a very structured set of documentation within a repo, and then a CLI that's around it that kind of the models are using to actually drive the work that's being done, whether it's creating a plan, a visualization, you know, creating some readout for a client. Effectively, like, building all the pieces of the process around actually writing the code to just happen, more automatically and standard across our team. So we have a couple of things. Like, one is this, like, big canonical plan document that has some similar structure,
but I'd say as the models have gotten better, we've actually reduced the enforcements there in the structure, kind of similarly across all of these. But once you have your plan, you actually build it out, and we have a very opinionated way on how agents will go and log their decisions and log what they're doing and just keep track of what they're up to. Everything checks and tickets. yeah, all of this is checked in. All of this is really kind of marked down for me now more HTML. I like to see these picture books that the agents spit out. But all of that gets checked in and then it serves as this surface where not only do you have the code as the source, you know, I think there's a debate on like, do you even need docs? Like the code can actually be the memory of a code base. And I do think you do. You need to know why you made a decision. You need to know the context around the conversation that was had. But ultimately that plus the code base. If there's a question, if there's something we need to answer, if we need to look back on why we did something, we just always have that in some durable record. And it's never like in someone's head. It's always in the repo. So that just gives like
our agents and our tools, these superpowers have all the context that I think a lot of engineering teams still just have in conversations or have in their heads. And our goal is to kind of continue to push that forward so that all the context is in one place and more and more of that work is just driven by the agent as opposed to us having to provide everything up front. Yeah, amazing. And one way we even measure, like, if any of these kind of, like, processes are working, is are we seeing an increase in trend in average story points per month of every engineer in the company? Right. And what do you think it is, let's say, compared to started this year? I don't know. What do you think? Do you think? Plus 50? I think, so, it really depends, because we have some people that, there's some picture that I saw on Twitter of a guy over, like, a wizard orb, and he's got these, like, things in the sky, and that's how I think of some of our engineers when they're whipping agents around. I'd really say, overall, it's been, like, a 2x increase this year in particular. I think, basically, if you think of December as the, like, Opus 4-5 moment
where the models really started to take on these long-running tasks to today we're back to Opus, but Opus 5.5, I mean, that's just a magnificent model that can really do a ton of work. Over that period, I've seen the actual output of engineers, I would say roughly double in terms of what they were able to do to what they able to cover in the same time span now Is a single story point worth the same now as it was a year ago We always trying to calibrate It a tricky equation Inflation or deflation right I don't know. I mean, in theory, there should be deflation, right? Yeah. Yeah. I don't know. That's roughly how we think about it. I would say at least once a quarter, we kind of sit down and evaluate what is our criteria for these story points? How are we actually estimating these projects? there's a fine balance to be made between like still rewarding this output but also as the models get better we do need to be able to kind of calibrate like the value that we're creating so overall like I would say roughly that 2x has played a similar role in like how we do these
estimations but I mean if I just look at some of the features and things people are building and pushing out now versus this time last year I mean it's it's insane what the difference has been Yeah. Well, so there's a couple of ways you can take this, but I'm just going to check in on the sort of model of preference stuff since that's always a topic of conversation. I think you just let people choose whatever tools they like, but then maybe you have some statistics on what is preferred in the office. It seems like Opus is leading. Can you care to estimate market share, whatever? The vibe right now is Opus 5.5, I think. No Fable? I don't particularly use Fable And I think a lot of people right now are just Opus is so good It's fast, it's cheap It kind of hits all my checkboxes I would say I've previously Had like two to three models Depending on whether they're cheap and fast Whether they're really smart Whether they can solve specific problems And now Opus is kind of covering my full range I think a lot of the team still reaches for tools
Like Codex when we need to do something maybe more in the computer use world. And really, workflow-wise, I think using both is still the best option. Whichever your driver is, which I think for most of our team is Opus 5.5, using a codex to review and having them actually work back and forth on your machine, I think still produces the best results. But right now, we're pretty aligned on those two. And are you still AMP maxing or no? Oh, I am AMP maxing. So you're using Opus 2 AMP. So, yeah, they recently... Or, like, that's the default model for AMP. Yeah, they recently launched, like, the ability to hook in your cloud code subscription. So that's been a pretty big game changer for me. Because that'll really cut your cost by, like, 80%. Totally. I mean, I love AMP because it takes everything off my computer. Yeah. They have this, like, cloud setup, the orbs. We actually co-hosted a happy hour with them last week, so it was cool to meet the team and orb out. but
that's never going to be a thing oh yeah I want to make it a thing this may be the first time in history that any human we're Orbin out we were Orbin out no they do say it's Orbin time yeah but yeah that's my that's my interface of choice and models are really between that if I'm leaning on Codex it's 6.6.1 did you give Claw Tag a shot like isn't it weird that Anthropic never captured the remote environment thing in the way that Orbs did yeah I think there's a piece of that I think on the AMP side of them being very opinionated and not trying to build this general solution, tools like Cloud Code in the Cloud and Cloud Tag, I think, provide value for teams that are really trying to, like, collaborate maybe on non-technical tasks. But part of the reason I love AMP is that it has all these cross-model functionalities, and I can do that. Opus writes it. You know, I can even hop to another orb and say, look at that orb and review it. and all of those things still come together to basically replicate what I'm doing on my machine.
And I just couldn't quite get there with a cloud code in the cloud, a cloud tag. Yeah, yeah, fair enough. Another thing I always track, I'm starting to track this year, is percent of, let's say, token spend to employee spend. I don't know if you have that number. So roughly, most companies are at maybe, let's call it $10 to $200 in spend per employee. The more sort of AI native ones would sort of convert that to a percentage, so roughly 10%. The average AI startup employee is about 1x in terms of employee spend and token spend, and then it goes up to maybe 5 to 10x in terms of token spend. Where are you guys in that range? I actually don't have a number off the top of my head. I'd say we're somewhere between, if we're talking like raw tokens, somewhere between one to one and maybe like two to one. Really? That's pretty high. And what we think about a lot is like when to reach for the biggest model.
I think every company is starting to think about that. But I will say recently our costs have been driven just way down from Opus 5.5. We kind of had an era of, like, everyone was using Astra and Fable, and they just gave the best results. But ultimately, those models are expensive. And, like, a lot of, like, you know, since the last time we talked, a lot of people had this sort of token maxing error, token leaderboards, everything. And then they were like, oh, no, no, no, no. Now we have too much cost. And, like, what's the most, like, predictable thing in the world? Did you ever fear about it? Or, like, you were just getting good ROI regardless? Yeah, I mean, there's a few ways that I think about it. is, like, we were for sure worried about it just as, like, our headcount was growing. And I think also, like, even though our team, I would say, like, I don't feel like anyone on our team ever really ascribed to, like, the token-maxing zeitgeist kind of. I had a few moments. Yeah, me too.
But it's like, well, if the boss is going to pay for it, like, I'm just going to go nuts, right? Because then you do the weird stuff so that you can scale back, but you have to do the weird stuff first to discover the lessons that you can take with you. Yeah, totally. I mean, this may sound crazy, and I'd be curious to hear your thoughts, but, like, I was talking to someone earlier about the debate that continues around, like, basically, I promise this is related. Like I was talking to someone earlier around the data companies, right? Like Micro One, Mercore, Handshake. And just like what does the long term for these businesses look like, right? Because like 90 plus percentage of their revenue is from the labs. And a number of these founders would argue that they think it's going to flip-flop, where in the next few years it's going to be enterprise-driven. And then like the thing that comes to mind, like the next thing I assume you have to believe if enterprises are going to be the core buyer of that data, is that enterprises are going to be doing a lot of fine-tuning on their own models. And then the question becomes, where is that going to make sense? It's either you think there's going to be better quality,
which, again, like the bar is just going to keep moving on the frontier, so that's like a hard bet to make. Then it has to be price. The price one feels hard to me because it's like we're just seeing token costs continue to go down on these models. And so I guess part of the reason we're not concerned internally is because it almost feels like we've kind of hit this, like, Pareto point of, like, costs are coming down at a per-task basis. Then it is way harder today for someone to token max and, like, really F the company in terms of cost than it was six to eight months ago. Like, I almost think six to eight months ago was the point at which, like, you'd be really concerned. Yeah. Do you agree with that? Yeah. I think there's a couple ways like the future might play out there. Like if there's a world where there's a Astra 6.5, a Fable 5.5, and they're super expensive, but they get the best results, I could see us trending back that direction. But generally I agree that, you know,
you look at something like Muse Wonder that they launched yesterday, today, and it's on the frontier. It's dirt cheap. the competition is heating up, both in open source and closed source. And I think that just will continue to drive costs down. And when you really look at it, a lot of tasks that are economically valuable can be done with OpenS 5.5. So, you know, it's that cliff of, like, would a 10 times smarter model really justify the cost of, like, moving some cells in a spreadsheet? Probably not. Right. So coming back to your customers and what you're seeing from the market, what is the most common ask that you guys get? And then what is something that people come to you with and you're like, no, we don't actually want that job yet? Yeah, so one way I think about this is I think about enterprises adopting AI as almost like these different milestones in a race. And I think, especially at AIE, when I tell people about what percentage of companies
have reached these milestones, they're kind of like mind blown by it. But it's like, okay, first milestone in the enterprise AI race is just rolling out a general purpose LLM to your people. And I'd say of the, you know, let's call it 100 enterprises we're talking to today, 90% have rolled out either quad or codex to their employees. Then the next milestone is like actually teaching people how to use it, like training and enablement, which like never gets the love that it should get, but is arguably more important or as important as the technology itself, I would say that's at like 60%. Oh, that's pretty good. Yeah, yeah. Like there's some group there of companies that are like, our people will just figure it out. But then there's like a good chunk that is like, okay, we need to teach our people what skills are. We need to teach our people the features and functionality of these surfaces. Then the next after training and enablement within a general purpose LLM is coding agents. And the crazy thing is like, I was asking a few people here, like what percentage
of enterprises do you think have rolled out coding agents to the engine product org in their company? And most people are like, it has to be 70 or 80%. The number is closer to 50%. Like every other enterprise that we speak to either hasn't rolled out a coding agent or what they are using is closer to not having a coding agent than having a coding agent. Then the next, and this is where like the biggest, I would say, drop-off is where the biggest diffusion gap is from raw intelligence to enterprise usage is agents in production for non-engineering work drops to 5%. Wow. It's like, I mean, you're in these conversations all day long, but most enterprises that we talk to that have, let's just say, more than 1,000 employees do not have an agent in production that is doing work that is not building software. Sure. And so I think there's a few things. One is there is because like there this this whole wave is driven by a combination of some small group of people understanding what is possible from this technology in a way larger group of people driven by FOMO
And by the way, FOMO isn't bad. It creates some forward momentum. But it also means that people will latch onto the things that are most in the zeitgeist. I guess now for the last year and a half, people have been saying it's the year of the agent. Or however long it is. Every year is the year of the agent. Like enterprises are like, can you help build us an agent for some back office task within the organization? Like that is one of the most common things. And it's why now a lot of the work we're doing at 10X is deploying agents into production outside of the entor for companies for repeatable work that they're doing. The second is permissioning and like RBAC. basically as every employee in the company has clawed or they have codecs and they need access to certain data it is turned into an absolute nightmare for cios and cios and they don't have basically a good gateway for easily doing almost like a like a control panel for uh data literally just what can you read what can you not read exactly and that is a huge issue so that's
like something we spend a lot of time on you make them for people or do you like buy them off buy something off the shelf? So basically we started by building bespoke for companies and now we actually productize that where we have our own gateway platform, our gateway solution. Yeah, exactly. Is there anything else that comes to mind that's like, we're hearing a lot from customers? I think that covered what we're hearing when it comes to like, particularly the agent deployments. I think one of the pains that just always gets discovered, um, I phrase it to the team is like, you can't automate a process that does not exist. So when you have 40 people that are all roughly doing the same function, but they're all doing it a little bit of a different way, there's actually, it's way harder to build an agent that's kind of proactively doing that in the background. You can totally sit down with them, give them the tools, walk them through how they could augment their own workflow. But when you really start to get the leverage is when you have these agents that are surfacing work to you, you're reviewing it, you're throwing it back, and you become more of this like, you know, everyone's been talking about becoming an agent manager,
and I think we're on the cusp of that. But when you zoom out, oftentimes our recommendation to companies is like, hey, first we need to build a process around this organization within your company, and then here are the steps for us to actually hand off that work to an agent in the background. But if we don't have some form of standardization, it's going to be impossible for the agent to know whether it's doing it right, for us to build evals around this system and actually deliver the value that an agent that is doing this function would have. And even one thing I'd be curious to hear your thoughts on, we were literally talking about this right before, is, and, like, CJ will be okay with me showing this, is, like, the, we were talking about, like, vertical-specific AI solutions and, like, what does the future look like for these solutions? And we were generally expressing an overall bearishness with vertical-specific AI solutions in different functions or industries. And part of it is just from our vantage point of spending all day in, like, the guts of enterprises.
There is so much nuance and so much inertia and, like, so many systems you have to wrangle and people you have to wrangle. And also when a buyer of a vertical solution is expecting truly a one-of-one experience, Like, we're in this, we are in an age where people are expecting one-of-one software solutions. And so if you're expecting that, it's no wonder that every software company is basically building up a team of FDEs because there's just this convergence happening of services and software when every company wants all this nuance that was not traditionally expected from software. And so I think it's really interesting to think about, yeah, like, four vertical specific solutions. Either one, how will they be able to do this at software margins if everyone expects a one-of-one solution? And also, why should we not expect, like, frontier models to just gobble them up?
Yeah. So to give some concrete examples, you're talking like Harvey for lawyers. Yep. Open evidence for doctors. These are the classic examples of people that are winning their domains. And you're bearish on them? I would say generally bearish on them, correct. Wow. Well, so far you've been wrong. And I think the answer very simply is access to data that ChatGP is not going to have, which is very common. That is a moat. Obviously, Anthropica and OpenAI are also acquiring those same data sources, but they're just not as dedicated as these guys are going to be. They do have innovations. If you've tried it, Harvey, they have the Tabular Review. Legora also have them. we've had the CTO on the podcast, where they have affordances and UIs and all that, that, like, is just customized because they only serve them. The pitch is focus, basically. Focus, affordances, maybe. In the way that you care about the last mile for your customers, they care about their last mile in terms of the software.
And as long as people train in that software, like, it never goes away. Like, as a banker or, you know, in my finance career, I could always access the same exact information from the NASDAQ, from the New York Stock Exchange. But why do I pay the $50,000 a year for Bloomberg? Well, it's just like that's what everyone, all my peers do. And it's all consolidated for me and it's all specialized for me so I don't make mistakes or whatever. Or like it's tied into my trading system or my chat or whatever, my news system. No, I think people playing for Bloomberg is the social network. I think people love the DMs in Bloomberg. There's that. There's that. But as a trader, I know I actually use that for a while. Yeah, yeah, yeah. So, I mean, I think there's a bunch of integrations and tools. And, like, I think ultimately it's hard to be bearish on any of them, mostly because the demand for software, the demand for tooling to do your job is just huge. And some of it, yes, it's going to be fulfilled by horizontal, generalized tools like the Claws and ChatGPTs. And some of it, you're just going to want something better. And, you know, I always think about maybe the success of Superhuman as an email client.
Everyone has Gmail. but here's this premium Gmail with more stuff for people who live in email all day long. And that's a market. It maybe wasn't the largest startup in the world, but I think reasonable people can disagree how large each thing is. Yeah, totally. I think what's not to be disagreed with is the total market is going to grow and all rising tide is going to result boats. And then you're just talking percentage commercial market share at that point. Yeah, I agree with that. Totally agree. I think there's even, there's like a differentiation between some new app go from the ground up with AI involved. That's what comes to mind when I think about Superhuman. I love Superhuman. I don't even spend a ton of time in email, but anything that has. No, you pay $30 a month just to not worry about it. Anything that has cool hotkeys, I'm into. Yeah. But when I think about like, I guess like products where they are really pushing some agent as the product that is doing work in some specific vertical, unless there is some very strategic compliance data, whatever it might be, moat.
I think those are going to struggle going forward as we start to see, like, quite literally the ability to either spin up your own really quickly, continue to compound as the models get better, or just, you know, those tasks start to fall into the world of the models just generally. but anything that has this like app and tool built around it kind of to my previous point changes the process and has an agent on top of it and I think like that that kind of builds on the same philosophy and I think that can still be super helpful and those will be successful yeah oh okay okay so so there's this there is a related view about this that maybe isn't quite as spicy as yours which is basically it's not like like nobody wants to use people don't probably don't want to use the agent that you built. They want to use the agent that they already have, and they want to plug in your data into their agent. So everyone is sitting on some part of your data, and they're like, use my agent, please. Please pay me that $20 a month. But you can't just stack up all these $20 a month subscriptions. Ultimately,
probably a small set of companies are going to own the interface, and then everyone just plugs into that overall agent, which I agree with. It's interesting that Salesforce, being one of the system of record companies, is the biggest probably or the most well-known, is embracing that path as, like, you will not use our agents. Like, we will just provide APIs and MCPs for you to plug into your stuff. Yeah, which is kind of cool. Okay, so I actually wanted to also walk through one example. So I just released my results for my Kill My SaaS competition where we replaced a mid-tier SaaS. I call it mid-tier basically in the sense that it's probably not that trivial, but it's not Salesforce. It's somewhere in the middle. And I think there's a lot of mid-tier SaaS out there that people are always talking about, like, the death of software, right? We recorded $40,000 a year. We spent $1,000 to replace it. It's going to production for the next conference. So we are that customer that says, like, I want the one-on-one tool and I'm expecting all these things. We're building a domain-specific or vertical-specific thing for our business.
And, like, so far it's going okay. Tell me where it's going wrong. Also, I'm wondering how many story points that is. Yeah, well, CJ can size up the story points on it. I mean, my general view is I think the ripping out of – my general view is, like, the more you move up marketing business, the harder the proposition of ripping out and building from scratch gets. I agree with you. Like, part of the reason when, as people have said, like – a very small group have said, like, Salesforce is really at risk. SAP is really at risk. Like, don't agree with that at all. It's just like those businesses in my mind just accrue value in this moment in time. And part of the reason they accrue value is there's so much money at stake where if a company gets it wrong ripping them out, you're talking about potentially hundreds of millions or billions of dollars. You're going to be risk averse. Yeah, exactly. I think for mid-tier, it really – it actually comes down to what is the size of the opportunity and is that ever going to be like the worthiest opportunity to rebuild inside of a company?
Like I'm trying to even think, like in an enterprise, let's just say there's some mid-tier SaaS that is a few million bucks a year. I think the first question is like from a percentage of revenue or cost perspective, is that going to ever move the needle enough to basically allocate engineer resource to? I think it going to be case by case I think for some enterprises the answer may be yes for other enterprises the answer may be no I think more of it is going to be like the thing that gets companies outside of like capability. Like, you know, we talk about how I forgot who created the repo that is basically the reverse engineer repo where. Yeah, exactly. Like everyone's talking about that right now. And even at 10X, like we, we like, we built our own like CRM from scratch. We, we, what did we build that our OS we built from scratch? And like one thing I think we realized, and every company realizes this is one of the beauties of software is not just the utility that you get from it. It is all of the headaches you don't have to think about in maintaining it
and improving it when it's not in your core. So I think it basically comes down to, is the size of the prize big enough to justify the cognitive load that is going to take from some amount of resource in your company to nurture something that is not core to your business? Evidently, like I think for your business, the difference of basically $39,000 a year, you're implicitly saying that it is worth it. It is not just about costs. That's defense. I also think about the offense of like, no, actually, our experience could be a lot better for literally every party concerned. Totally, totally. And so, yeah, I think part of the thought there is actually just there's a significant – basically, it's not just that – so there's two pieces to it. One is like not just we're being overcharged for a product, but it's like the product has been mediocre for a long period of time. What would the 10x better version of this product look like? Because we are the customers and we can iterate with, like, minutes and not months. Totally. I think, I actually think what's interesting is I think startups and, like, even, like, high-growth, mid-sized companies can be nimble in that way.
I think for enterprises where, like, they're so entrenched in a certain capability, rarely is that going to be the thing. Rarely are they going to say, like, oh, we can create a 10x better version of the SaaS we use and we're going to spin it out potentially as its own thing or whatever. it is. Like, I just don't think enterprises function that way. For sure. Yeah, it's been discussed. Actually, I would say that, you know, you talk about automation. The more spicy thing is, are they automating humans, right? And like, once everything is automated and smooth sailing, do we, you know, replace those jobs? I don't know how much you can speak to that. Yeah, I mean, I think there's two pieces here. I really deeply believe in the like, AI will produce good for humanity. It's going to augment people's jobs. It will absolutely change and displace, but I think it's more of a movement as opposed to just, like, cutting off work. Yeah. I think A16Z posted something about how, like, call centers are truly now on the decline,
and AI is starting to handle more and more of that work, and ultimately, if that is a skill you've built up your whole career, that is devastating to have something come in and take that function over. That being said, part of what we do when we're talking to customers about, hey, an agent is now going to do this work, is actually around reallocation. I don't think any business would claim, like, once we have this solved, there's nothing for this group of people to work on and try to solve. So our approach really is about what can we replace and then what are the next biggest problems to look at? And I'd make an argument in most large companies that that cycle kind of continues forever. There's always the next problem. If I think about how we've grown. Infinite demand. There's always been another problem. And actually taking those people that may have this, like, super deep subject matter expert and bringing them above water to start to maybe work more across teams or, like, think about parts of the business less so on, like, the level of a sell in a spreadsheet
and more about how these teams are working together. Ultimately, in the long run, I think that keeps most people there and allows those businesses to become more nimble and actually tackle, like, the big meaty problems and not the, like, drudge of most people's day-to-day. When you're thinking about someone that's in, like, a finance division, they're mostly in spreadsheets, but how can we elevate them to think strategically about the business and where money is allocated and things like that. Yeah, and I also feel like when we have these conversations around, like, job displacement or job reallocation, we talk about it as this thing, like, happening to people. And one of the reasons I don't like that is I feel like it doesn't give enough credit to people to, like, have agency in their own lives, meaning I think you can adjust. Yeah, people really should be thinking. Like, when I think about, like, enablement or people re-skilling, I think it is the job of an employer because they want to drive growth in their business, but it is also the job of an employee.
And I think when people say that AI is going to replace all of the work that people don't enjoy doing, I think that's a little bit of, like, cope for the reality of just people are going to be put out of jobs because a lot of people don't have the luxury of liking or not liking a job. They do a job to make money. And also I think people, to the extent that it's possible, should have agency in saying to themselves, okay, what is the stability or replaceability of my job over the next few years? And if I am to try to skill up in a way that I'm better protected, what does that look like? People have agency to say that to themselves and actually take action. Yeah. Yeah. I think that's a good message for people to reflect on. The last piece I wanted to touch on before I let you guys go is just New York. You know, greatest city in the world, according to some people. What's the mood generally among the people that you talk to? whether it's at work personally, what's the feeling, right? Like I live in San Francisco all day long. Everyone's just in agents all day long. Like, you know, the discussion is instincts or grok or muse.
It's not like, do you like AI or not, right? And I feel like I want to step out of that bubble for a bit. But it's still New York. It's still progressive. It's still forward-looking. Yeah. I mean, what I'd say is I feel like basically I would just say there's a bubble in New York that is a smaller bubble than exists in SF. Okay. If SF is like a big bubble, I think we at 10X feel like, you know, we are in a, what I would say is like a microcosm of San Francisco because of the people that self-select to work at the company. And then also the companies that we're partnered with and like the people that we engage with in New York. But I would for sure say also it is true that it is a smaller universe than like in SF, when you go to SF, it feels all encompassing. where it's like everyone, everywhere you look, there's someone who, similar to like AIE, how I was saying earlier when I went on stage, like if people go on Twitter or X because they feel like they're on Edge City, they're living in the future, like AIE is like that on steroids.
Like I feel like SF is similar to AI. I mean, it's like, I probably like the overlap of AI generally and people who have lived at some point in their life in SF is probably a very Oh, yeah. Large overlap. We're roughly 1% of the city now. Actually? For Wolfsburg, yeah. That's crazy. Yeah. But, like, to that point, I just think, like, it is in the culture and the DNA of SF where a very big population of people live in the future. I think you can find that group in New York, and I think we at 10X have found that people. And part of our goal is to drive like AI as a hub or New York as a hub for AI in the U.S. because there is so much commerce here that like it is going to be a place where diffusion of the technology actually has such a meaningful impact on the GDP of this country. I think the bubble is smaller now and we take it almost as like a charge of ours to increase our bubble. Maybe I don't know that it's possible to get to SF size, but I do think we can have a meaningful impact on getting more people to live in the future here. there's a physical like you see it on the billboards yeah slowly creeping in oh totally
people used to remember the friend campaign where people would like spray all sorts of graffiti on that that was i think that was like a little bit of an intentional rage debate but now you have the unironic ai billboards and people are like i guess that's part of life now 100 yeah so i i think it's like i think there's an opportunity to bring kind of like the the edge and like the just like the living in the future nature that SF has created because of just like the economic climate that exists or because of venture, because of tech companies, then because of the people that are attracted there. But I also think of us as like, we're in a, it's weird. We're in a smaller pond for AI, but I would argue we're in as big of a pond, if not a bigger pond for like commercial value. Yeah, totally. And so I actually... The way I put it is like, the reason I do AI in New York is I bring all the people from San Francisco to come here and meet their customers and also... Exactly. Like, get a reality check. Totally.
And I actually think there's a really interesting arbitrage there. Yeah. Yeah. Yeah, totally. Okay, awesome. Call for hiring. I know you guys are always hiring. Yep. What are you hiring for? What's changed? Yep. We're hiring for deployed engineers at 10x. Just go to 10x.co. We're also always hiring AI strategists, which are basically technical consultants who are leading client engagements. And the team is 75 strong in New York City. We're continuing to make New York City our home. And then if you are an enterprise who is looking to actually get AI native and you've tried it, it's not working, hit us up. I promise we'll do better work than not going to name them, but a lot of other traditional consultancies. Ooh, spicy. CJ? Yeah, I mean, I echo all of that. I'm particularly looking for engineers. What's a special project? What is that? A special project involves anything outside of kind of our client work. So I think about my brain right now. It is building that meta harness and system internally that basically it's like find the bleeding edge of what the models can do
and give them tools to augment how well they can do it. And then also internally, working on the platform that Alex mentioned, big goal there, diffuse these background agents and actually get them out to enterprises in a way that's truly, truly helpful to them. Yeah. And solve a lot of those, like, messy IT problems that we hit on earlier. Dude, when you have some solutions, we take guest posts on the Layin Space blog. I'd love to welcome some sharing of knowledge. But otherwise, thank you so much for your time. Thanks, man. Good to see you again. Yeah, likewise. Appreciate it. Once a year. Once a year. Hell yeah. Thank you.
番組の概要欄(原文)
Alex Lieberman and CJ Hess join swyx at AI Engineer New York to discuss Tenex’s approach to AI-native engineering, paying for outcomes, MetaHarness, enterprise AI adoption and rebuilding SaaS. Show notes: Tenex: https://www.tenex.co/ Building an AI-native SDLC: https://www.tenex.co/blog/building-an-ai-native-sdlc Earlier Tenex episode: https://www.latent.space/p/10x-ai-engineers-with-1m-salaries Kill My SaaS: https://www.youtube.com/watch?v=zlD-CkLVKtU Full video: https://www.youtube.com/watch?v=Vki6cklFqxo 0:00 Cold open 0:26 Introductions 0:51 What Tenex does 1:32 Why CJ joined Tenex 3:17 Paying engineers for outcomes 7:20 Inside MetaHarness 10:25 Models and long-running tasks 15:11 Token spending and ROI 19:29 The enterprise AI adoption gap 23:22 Why agent deployment is hard 24:42 Vertical AI and enterprise software 30:32 Kill My SaaS 35:23 AI and jobs 38:18 New York’s AI ecosystem 42:28 Hiring at Tenex This is a public episode. If you'd like to discuss this with other subscribers or get access to bonus episodes, visit www.latent.space/subscribe
出典・この記事について
- 番組
- Latent Space: The AI Engineer Podcast(Latent.Space)
- 元の回
- AI for the Fortune 2000: How Tenex Builds an AI-Native SDLC — Alex Lieberman & CJ Hess
- 配信日
- 要約作成日
- 公式サイト
- www.latent.space/podcast
この要約・解説記事は、元の音声を文字起こしした内容をもとに AI(Claude)が日本語で作成したものです。 固有名詞や数値に誤りを含む場合があるため、正確な内容は元の音声でご確認ください。制作方法について
関連エピソード

AI企業が賭ける「知性より性格」――パーソナリティが競争軸になる理由
The AI Daily Brief: Artificial Intelligence News and Analysis

プログラマブルなデータセンター — SF Compute の Evan Conrad が語る計算資源市場の物理的決済
Latent Space: The AI Engineer Podcast

Google CEO サンダー・ピチャイ:AIの無限の可能性、計算資源の不足、そして次のAIプロダクト
Big Technology Podcast

ワールド・ワイルド・ウェブと購買力を持つボットたち
Agentic Conversations (formally mlops.community)

Everyday AI の裏側:Jordan が最もよく使う AI ツールとワークフロー9選(再放送)
Everyday AI Podcast – An AI and ChatGPT Podcast

Codex の Record and Replay:一度見せるだけでエージェントに面倒なワークフローを教える(リプレイ)
Everyday AI Podcast – An AI and ChatGPT Podcast