連合学習でエージェント型AIを強化する:Flower Labs の Lorenzo Sani 氏に聞く

Implementing Federated Learning to enhance Agentic AI

Practical AI43分
連合学習でエージェント型AIを強化する:Flower Labs の Lorenzo Sani 氏に聞く

連合学習でエージェント型AIを強化する:Flower Labs の Lorenzo Sani 氏に聞く

Practical AI

0:0043:33

要約

Flower Labs の研究者で Cambridge の博士課程に在籍する Lorenzo Sani 氏が、連合学習(Federated Learning)の基本と、LLM やエージェント型AIへの応用を語った回。データを移動させずに学習することでプライバシーを守りつつ、これまで使えなかった私的データを活用できる点を説明した。エージェントの軌跡(trajectory)が改善に有用である一方、機微な情報を含むことも指摘している。自宅でのオープンウェイトモデル活用例も紹介された。

この回のポイント

  • ●連合学習は、学習のための計算をデータが生成される場所へ移す手法で、データそのものは移動しない。これがプライバシー保護の第一の要素だと説明された。
  • ●学習済みモデルが個人情報を記憶してしまうリスクは別問題で、差分プライバシーなどの手法が統計的な保証を与える。ただし適用の可否はケースごとに異なり、研究としては未解決の部分もあるという。
  • ●エージェントの軌跡にはプロンプト、ツール出力、MCP サーバーや RAG などの外部情報が含まれ、改善に有用だが私的情報も多い。連合学習はこの分散データでの学習に自然に適合するとの見方を示した。
  • ●プライバシーを重視する用途では、制御しやすく問題があれば修正できるオープンソースモデルを出発点にしたいと述べている。
  • ●モデルが小型化・低コスト化するなか、企業は自社の軌跡を分析して失敗モードを特定し、外部提供者に頼らず改善する動きが強まるとの見通しを示した。
  • ●手術ロボットのような機微な分野では、複数の病院などからデータを集める協調学習が現時点でも有効だと語った。

章立て

  1. ゲスト紹介と物理学からの転身

    Sani 氏が物理学出身で、医療応用でのプライバシー課題から連合学習と Flower に出会い、Cambridge の博士課程に進んだ経緯を語る。

  2. 連合学習とは何か

    公開データと私的データの違い、学習計算をデータの所在地へ移すという連合学習の基本的な考え方を説明する。

  3. プライバシーはどう守られるか

    データが動かないこと、差分プライバシーなどの手法、モデルの記憶リスクについて議論する。

  4. オープンモデルと閉じたモデル

    プライバシー重視の用途でオープンソースモデルを好む理由と、クローズドモデルを検証する方法を述べる。

  5. エージェントの軌跡と連合学習

    エージェントが環境内で行動し長い軌跡を生むこと、その軌跡が改善に有用かつ私的であること、分岐と統合の構造を説明する。

  6. ハロウィンパーティーの仮装審査

    自宅で動かすローカルのビジョン言語モデルのエージェントが仮装を審査したエピソードと、今後の家庭内プロジェクト案を紹介する。

  7. 企業での活用とロボット・医療

    軌跡の分析による改善、解釈可能性、手術ロボットなど実世界での協調学習の役割を論じる。

  8. 未来への展望

    誰もが自分のノートPCや自宅で同じパイプラインを動かせる未来への期待と、制約や不便さが革新を生むという考えを語る。

解説記事

Practical AI の今回の放送では、共同ホストの Chris Benson 氏が、Flower Labs の研究者で Cambridge 大学の博士課程に在籍する Lorenzo Sani 氏を迎えた。テーマは連合学習(Federated Learning)と、それをエージェント型AIにどう結びつけるかである。

連合学習の基本:データを動かさずに学ぶ

Sani 氏は物理学の出身で、修士の最終年に医療応用の機械学習に関わるなかでプライバシーの課題に直面し、連合学習に出会ったと語る。初期の Flower フレームワークのユーザーだったことが、Cambridge の研究グループとの縁につながったという。

同氏の説明によれば、ウェブ上の公開データは比較的自由に集められる一方、医療記録のような私的データは、正当な理由で簡単には収集できない。連合学習は、学習の計算をデータが集められた場所へ移し、反復を重ねることでデータを外に出さずに有用なモデルを得る考え方だ。公開データだけでは得られなかったデータ源を使えるようになる点も、プライバシー保護と並ぶ動機として挙げられた。

プライバシーは本当に守られるのか

Chris 氏が投げかけたのは、手元で学習しても私的な情報がモデルに取り込まれないと言えるのか、という問いだ。Sani 氏は、データが元の場所から動かないことが第一の保証になると述べた。誰かが通信を傍受したり、医療記録を直接覗いたりすることはできない。

問題は、学習済みモデルが個人に関する情報を記憶してしまう可能性にある。これに対しては差分プライバシーなどの手法が統計的な保証を与えるが、適用しやすさは設定によって異なり、技術的にはいまも研究課題が残っていると同氏は説明した。産業界では、費用対効果が合わず連合学習を断念するケースもあれば、端末でのデータ収集から最終モデルまで一貫して使うケースもあるという。

オープンモデルと閉じたモデルの比較では、閉じたモデルの内部は分からないことが多いと前置きしつつ、API 呼び出しによるプロービングで情報漏えいを調べる手法もあると述べた。それでも、プライバシーが重要なアプリケーションを作るなら、制御しやすく、問題が見つかれば修正できるオープンソースモデルを出発点に選びたいというのが同氏の立場だ。

エージェントの軌跡という新しいデータ

議論の中心は、エージェント型システムが生み出す「軌跡(trajectory)」である。エージェントは読む、取得する、変更する、削除するといった行動を取り、その実行環境にはファイルシステムやカメラ画像など、利用者自身に関わる情報が含まれる。軌跡には、モデルの出力に加え、ユーザーのプロンプトや、MCP サーバー、RAG などの外部コンポーネントからの情報も入る。

Sani 氏は、こうした軌跡が長くなるほど、本人が私的と考える情報が蓄積されると指摘する。構造としては、メインの流れから複数のサブエージェントが枝分かれして情報を集め、最終的に結果がメインラインへ戻るツリー状のイメージで捉えられるという。

軌跡は、誤字、同じ語の別の意味での使用、実装の悪いツールなど、現実の雑多な失敗を含むため、モデルをそれに強くするうえで有用だ。しかし、体の不調の相談のように私的な内容も多い。だからこそ、分散した私的データで学習できる連合学習が自然な選択肢になると、同氏は見ている。

企業の動きと、ロボット・医療への示唆

Sani 氏は Flower Labs での経験から、能力の高いモデルが小型化し、デプロイが容易になり、コストも下がっていると述べた。その一方で、モデルを特定の用途で改善するには、失敗モードを特定し、データを集めて分析する必要がある。外部の提供者は完全なトレースを開示しないことが多いため、自社の軌跡を管理したい大企業の動きは強まるだろうという見方だ。IP や社内フローが競争力に直結することも理由に挙げられた。

解釈可能性についても言及があった。同氏はロボットが手術を行う場面を見た経験に触れ、なぜその手順を選んだのかを確認できるべきだと述べた。こうした機微な用途では、標準的なサブスクリプションでは得られない程度のデータ分析とモデルへの制御が必要になるという。

医療分野では、人によって条件が異なり、シミュレーションで試行回数を増やすことも難しい。現時点でモデルを改善する確実な方法はデータを増やすことであり、複数の病院などのサイロからデータを集める協調学習が、現行の収集パイプラインや学習手法のままで役立つと語った。

自宅のローカルAIで遊ぶ

番組の途中では、Sani 氏がハロウィンのパーティーで、ルームメイトと自前のビジョン言語モデルを使った仮装審査の仕組みを作った話が紹介された。カメラの前でスペースキーを押すと写真が撮られ、複数のエージェントが「ハロウィンらしさ」「怖さ」「トラッシュ感」を議論して採点する。参加者はプロンプトインジェクションを試したり、複数人で組んで高得点を狙ったりと、システムを攻略しようとして盛り上がったという。

今後の案としては、ゴミ出しなどのリマインダー、夜の議論の録音と要約、新着論文を朝に音声でまとめるブリーフィングが挙がった。Chris 氏も、屋外カメラで野生動物を検知して通知する使い方を挙げ、仕事だけでなく生活全体にローカルAIが役立つと話した。

まとめ

今回の対話は、連合学習を単なるプライバシー技術としてだけでなく、これまで使えなかった私的データを活用する手段として位置づけた点が印象的だった。エージェント型AIの普及で、プロンプトやツール利用を含む軌跡が新たな価値あるデータになる一方、その扱いはいっそう慎重さを求められる。日本の読者にとっては、医療や製造など機微なデータを抱える組織が、データを外に出さずにエージェントを改善する選択肢として注目できるだろう。また、オープンウェイトモデルを自社や自宅で動かす流れが進めば、制御性と透明性の面で利点があるという同氏の見方も、モデル選定の参考になる。

文字起こし(英語・自動生成)

Welcome to the Practical AI Podcast, where we break down the real-world applications of artificial intelligence and how it's shaping the way we live, work, and create. Our goal is to help make AI technology practical, productive, and accessible to everyone. Whether you're a developer, business leader, or just curious about the tech behind the buzz, you're in the right place. Be sure to connect with us on LinkedIn, X, or Blue Sky to stay up to date with episode drops, behind-the-scenes content, and AI insights. You can learn more at practicalai.fm. Now, on to the show. Welcome to another episode of the Practical AI Podcast. I am Chris Benson, your co-host. Daniel Whitenack is out on paternity leave right now, so he won't be joining us. We've got a good conversation coming up today, I know, because with us we have Lorenzo Sani, if I got your name correct there.

And Lorenzo is a research scientist at Flower Labs. He is also finishing up his PhD at Cambridge in computer science. Welcome to the show. Hello, Chris. Hello, everybody. Thanks for having me today. Hey, absolutely. You have a really interesting set of research that you're working on. We're delighted to have you on the show today. I'm looking forward to talking about it. We've got a lot of questions about it. But I wanted to actually start off with the fact that a little bit about your background. I know you came from the physics world and moved over, and we've seen that a fair amount in research scientists and AI. Daniel, the co-host, who's not here today, is in the same boat. I'm just kind of curious if you could give us a quick, you know, kind of how you arrived at what you're doing now, having started on the physics side of things. Yeah, of course. You're right. I have a physics background. I've been studying physics for five years after my high school. I was in Bologna. Amazing place, amazing people and very good courses as well. And especially during my last year of master's, I was looking into topics related to machine learning and the group there was working on medical applications.

We needed a way to kind of preserve privacy and looking into those privacy-sensitive scenarios. And back then, federated learning was quite new. So I started looking into it. It was very interesting. I loved the motivations behind it and the way to carry along the privacy-preserving component to it. And there's Ralt. I was one of the very first users of the Flower framework. and this brought me to meet all the flower people as well as the research group in Cambridge that was developing it and things got along. Luckily enough, the professor Nick Lane here was looking for PhD students. I was very excited to join this line of research and whatever was around it and I got lucky. I got a seat. I started working with the team. I started developing my own applications and methods. And over the course of the last few years, I got more familiar with the latest advancements of AI, I would say,

like these LLs and everything related to it. Now I can say I'm very familiar with everything that goes from collecting the data down to serving the models and using them day to day. Can you talk a little bit about as you dived into those areas, what were some of the specifics that really drew you in? You know, what were some of the first problems that you addressed that kind of got you started in the area? And what drove the passion regarding that? Yeah, it's a very good question. I've thought a lot about this after a couple of years that I took this path because, yeah, I wanted just to, you know, go back and try to understand better my choices and where did I take them. I think the main reason was related to the complexity behind this technology because back when I decided to do physics, complexity was the most fascinating thing about studying physics

and getting to know the world. And for this technology, it's mostly about we have a lot of data. We want to make sure that we have good machine learning technologies to learn from this data and get useful stuff done. But this data is very complex. And the training procedures are very complex. So these things excite me a lot. In the federated learning kind of area, the complexity goes into the distribution itself because you have all this siloed data. It's very scattered, very turgineous, very difficult to deal with in the standard way. But federated learning provides a good way to train, to train on this and get the intelligence that you want. It's similar to the direction I took when I started my PhD for the LLM pre-training stuff that I've done. There the question was, can we use the federal learning technologies to train these language models? It was like something that nobody did before. There was a few works from DeepMind that were very interesting,

but we wanted to take a much deeper approach. And at the beginning it was challenging, But then, like, we realized, okay, we can do this stuff. We spent a lot of months in developing the tools, the basic tools to do it. And now we have plenty of papers showing that we dig deeper into the technology, into the science of these things, and we can get good results out of it. So for those who aren't familiar with it, can you talk a bit about what federated learning is, what the benefits of federated learning are, and specifically, like, as you talked about, like, developing those tools as you were doing that, you know, what drove you into that? Why was that the thing and what was the benefit that you were able to achieve out of that? Yeah, absolutely. So, federal learning is a semi, well, for the history of the world, is a semi-new technology. Now, probably in the eye, it's pretty old. But the idea behind federal learning is the following.

So data is collected in many different places at once, right? We collect data from our edge devices like phones or laptops and so on and so forth. And all this data is usually then centralized into the data centers that are doing the machine learning pipelines to train models and to learn from them and to provide useful insights, to construct applications and so on and so forth. Now, most of this data is openly available. We know that you can scrape the web and gather as much as you can, if intellectual property is preserved and so on and so forth. But still, there's a lot of data you can source pretty freely. But there's a massive chunk of data that is completely private, that is very difficult to source, right? And it's private for a good reason. Sometimes it's your medical records and you don't want everybody to look at it or some very personal information that you don't want to disclose. But this may be useful for training machine learning models.

And, of course, we have regulations that are protecting our privacy from this data collection and whatever comes next. And federal learning comes into place in order to try to satisfy the regulations, protect your privacy, while still being able to learn from your data and construct useful applications for the users, for the people who are actually generating this data. In short, Federato Learning tries to move the training pipeline, so all the computations that you need to train your machine learning model to where the data is collected. Of course, you need to compute there, not just the devices that are collecting the data, but iterating these training procedures. Eventually, you will be able to obtain a good machine learning model that has learned from your data and provides useful insight. Could you talk a little bit about, there's a specific point there that I'm really interested in, that is if you're applying federated learning to private data, and to your point,

there are aspects that you don't want to reveal necessarily to the public, but you want the benefit of the learnings that the data could offer. How does training at that source of the data keep it private? How do you know that the private aspects of that data are not taken into the model themselves in a way? How do you achieve that balance? This is a very good question. And technically speaking, it's still kind of open for research. There are bounds. There's a lot of research that provides statistical bounds and guarantees of some sort, depending on the setting. the first ingredient for protecting your privacy is the fact that your data never moves from where it's collected so no one can intercept traffic or or actually look at your data no one can open a tab on chrome and you know just look at your medical records and stuff so this is a very

strong aspect something that is fixed and it's guaranteed at all times the question becomes more when you've trained a machine learning model, does it have, as it memorized, something about yourself that you didn't want it to memorize, right? And that's where privacy can break. And there's techniques, a lot of techniques, to train these machine learning models in order to prevent this from happening. Techniques such as differential privacy and many other things are providing, these are providing statistical guarantees that these models are safe, secure, and they are not breaking your privacy. but usually these depend on a case-by-case because in some settings you can apply these things very easily. In other settings, it's very challenging. Other times, you just cannot apply them. There's plenty of industry who is trying to apply federal learning to their use cases, and sometimes they abandon this opportunity because they realize that it's not convenient to them. Other times, this works pretty well, and they use it time-to-end from when they start collecting the data on the Edge device

when they produce the final model that does the application. It raises an interesting question from my standpoint in that as you're thinking about industry, you know, building the models, you know, you have these big frontier models that are private and closed, and then there's the world of open source, open weight models out there Does the nature of those models being closed or open or anything affect how we should see the application of federated learning from maybe from a trust standpoint or a utility standpoint? You know, it makes me wonder if you're one of these giant global companies that's producing a large closed model versus some of the open models that are available. Should I feel safer? with one or another into your way of thinking? How do you evaluate that personally? Yeah, this is a very tricky question because we know very little, right?

Like we don't know how these closed source models are constructed. We know a little bit more about the open source ones, but not 100% of it. I tend to be very optimistic on this side of things. Like I hope and I kind of trust everybody to do their job and to try to enhance the models and improve them in order to maintain privacy, to maintain the data they can collect and they use for training private and not to leak anything and to be safe and all of this. Of course, there's techniques to probe models, even though they are a closed source. Some techniques do actually work by just doing API calls and just probing the model directly, they get the outputs and see if they are actually containing information that shouldn't be there. But with open source models, it's much easier because the amount of techniques that you can use is just many, many more. I would say that if I had to develop a privacy-heavy application,

I would prefer to use an open source model as a starting point, especially because I have more control over it. And in case there's something broken out of this open source model, I know there's a way to fix it and I can pull it off. Otherwise, for closed source models, it's very difficult to say, OK, 100 percent, if there's something broken, I'm going to be able to fix it. Can you think back to a time when you wanted to share your expertise or maybe an open source project or your resume online in a very compelling way that looks professional? It can be super overwhelming to get to that point. I know it has been for me over time with my personal website or things that I've put up online for practical AI. I want those things to match what I have in my mind. And that's why I love what Hostinger is doing with their AI builder, which lets you get to a working version of your dream website fast. It allows you to feel confident preparing for your next job interview or hearing from prospective clients of your consulting business.

Whatever that is that you're trying to share online, Hostinger's AI Builder can help you get there and share that. And now through December 14th, they're running their Black Friday and Cyber Monday pricing where you can get a premium plan for just $199 per month. Go to Hostinger.com slash practical and use code practical for an additional 10% off Black Friday and Cyber Monday pricing. That's Hostinger.com slash practical and use code practical for an additional 10% off Black Friday and Cyber Monday pricing. All right. Well, in the first segment, we were talking a bit about kind of the background on federated learning and some of the issues, you know, privacy and stuff around it. Could you, to turn a corner a little bit, could you talk a little bit about how you're applying federated learning, some of the use cases, maybe how Agentex fit into the framework and some of the use cases or applications that you've been diving into?

Absolutely. So in my first research experience during my PhD, we started to develop federated learning technologies for training language models. Back then, it was pretty challenging and fairly new. Basically, the idea behind it was that we were able to source much more data than what was available. So the idea there is I'm not using federated learning just to preserve privacy, but also to be able to tap into new data sources that could be very valuable. So in the context of language models right now, what I've seen applied and what I've applied myself is mostly related to this kind of outputs. Like I really want to use the Federal Technology Technology so that I could use this massive amount of data that otherwise it's not available. And hopefully I'll be able to construct much better models or models that can reflect much better what users produce in terms of data.

When it comes to the most recent kind of advancement for these LLMs and AI technologies, yeah, we've seen a lot of use in agentic systems. These agentic systems are much more complex than the single model application because you have interactions, you have multiple users, you have interactions with external services, and you have these kind of trajectories. It's probably a word that everybody has heard recently more and more. And there the privacy component and the federated learning component comes into place because all these trajectories do not just contain outputs from the model, but also the prompts that the user type into the chatbot or the applications they're trying to use. Or maybe some third component, third-party component, like MCP server, RAC systems, all these things that are interacting with the language model

in order to provide it with more information regarding the prompt that you just passed. And all these trajectories are super useful to improve these AI systems that are relying on agents. Why they're useful? Because trajectories may get messy. They are very long. Models can make mistakes, and these mistakes may come from just, I don't know, a word that is misspelled, or a word that is used twice to refer to different things, or a tool that was a little bit broken because the implementation was not that good. And whenever you have this kind of trajectory, this kind of usage, you want your models to be better at dealing with this. And they can be better if you collect enough data to train them in these objective systems. And this is what Federal Talent Learning can provide, a way to train on this distributed data that is very private because it contains your prompts. It contains what you like about the work you do or about the conversation you like to have with Chagipity or clothes, right?

All these things are very private. Sometimes, sometimes they're not. You're maybe just asking about, oh, tell me the news. What's today's news? But other times they are. Like sometimes I ask my agents about, oh, you know what? I've been doing this thing and my knee now is not feeling good. Should I be contacting that or not, right? these sort of things, and you don't want this data to be available to anybody else, right? Sure. And if you want to improve your agentic systems, the power relying on this kind of trajectory is federated learning is a natural way to train in a distribution of these AI systems. Could you talk a little bit about, like, you know, we've dived into some of the complexity of introducing agentics and all those trajectories, And I think one of the things I'm trying to grasp right now is, like, when we were talking about just the model before the break, it was easier to grasp the private and stuff like that.

As you're talking about introducing agents at some scale, and they are producing these trajectories, and presumably you have many parallel trajectories at the same time. What does that mean? How do you put that together with federated learning in such a way? What does that mean in real life? How do you see that? Because it seems like it gets quite complicated quite quickly. How do you – can you kind of bring that together and lay out what that seems to you? Because I'm trying to follow you down different paths and trying to figure out how they fit together. Yeah, so things get very messy very quickly, and you're right on that, especially because agents – what's the difference between a single model and an agent is that the agents can take actions, right? Like that's the definition of an agent, like the simplest definitions that you can get. Taking actions means that it can read things, it can scrape things, it can modify things,

it can remove things. And every of these steps relies on the fact that these agents execute in an environment. And this environment contains part of yourself. It contains, I don't know, information about your laptop, your file system. It may contain information about your camera, your images, what you're doing, and also your props. All these things compound. So whenever you have a long-running trajectory, the amount of information about yourself that you may retain, that you may think they're private, increases more and more as the agent goes along, right? because it can take more and understand more about yourself to produce a final output. All these things are basically constructed as you have the initial prompt, you let the model do its thing. Then maybe you have two calls. You have call-in-sub agents, so something that branches out. You can think about like a line that branches out and gather information. You can imagine that I'm getting down from a little database

That could be your file system or some web page or, I don't know, your medical records or something like that. And this informs the model, constructing another part of the context it's operating with. And then as you go along, this information gets always compacted into the main line of work to get you to the final outcome. So this is kind of the way people are usually thinking about these long-running trajectories. So you start with a prompt, then at some point you may have branches out more and more. It's like a tree, and then things get back into the main line when you get to the final answer. Gotcha. That helps a lot. I appreciate the context on that. Can you talk a little bit about some of the things that you done Any interesting projects Any fun things that you done with this Things that have caught your attention I know before the show you relayed something, and I was hoping you might share that as well. Absolutely. I was looking forward to this question. So, yeah. I mean, we're just after Halloween, right?

Halloween was on the 31st. and I decided to give a party in my house with my flatmates. Hopefully the landlady doesn't know about this. But anyways. It depends on if she watches Practical AI. We hope she does, but, you know. We hope she does, yes, but I won't ask her at this point. Maybe if she doesn't. Anyway, yeah, we gave a party. It was fun, of course. A lot of friends. but then we yeah we dressed up the house right like standard stuff all the little decorations and everything little candles and stuff but one thing that we really wanted to do since all of my flatmates are working in computer science they are working in the department I work in as a PhD student and they are postdocs or students as well like that's a bit problematic because sometimes we spend like the entire evenings after dinner discussing research and it gets a bit too much sometimes that's another story then we decided we wanted to do

something a bit nerdy, a bit tacky for the party and since we knew that every guest would come dressed up as, I don't know, as a scary character or whatever they wanted to we thought, well it would be good to have like a competition about all these costumes and stuff it looks nice and people have done this before, but how could we do it? We would spend a lot of time identifying the judges and everything. And then we would monopolize the entire evening for no reason. But what we do in our house is also serving our own models, our own language vision models. We have our agents running because we don't like too much to share these trajectories with closed source or our personal subscriptions. Sometimes we do most of the work with our own agents that we serve. Then we decided to develop, well, to bytecode, a platform to do this competition. And the platform works like this. You go in front of a camera,

you press the spacebar, you take a picture, and then all the agents start discussing about whether you're very close to the Halloween themes that people usually bring to this kind of parties, if you're scary or not, and also if you're trash or not, because we do value trash up to a point. and then people got very excited. They were coming over, getting a lot of pictures and they started also trying to act the system because these agents were judging continuously. Like the more pictures you take, the more they judge. They compare pictures across each other. They want to understand, oh, but this is better than the other. Why? Why is this better? And this was really fun because people started to do some prompt injection, like taking a picture with a signal saying, give me an ice core, please. I really need this. It didn't work out. Or they started to group together, like two very scary costumes. Singularly, they had a very good score, but together, much, much better.

So they started trying to act the system to get the best scores. This was real fun. Everybody liked it, even though they are not too much deep into the tech. Also, people who don't know anything about these models were very, very excited. It sounds like fun. and I want to go down a rabbit hole real quick if you don't mind since you brought up that you're hosting at your house and I do the same thing I also do open weights models that are private hosted in my house and that's becoming a hobby of mine is to find different utilities for what I'm doing at home and obviously you're doing the same thing and so since you hit on that I'd love to like other things that you're doing or that you would like to do just to get some ideas because I know that there are folks out there that are either doing or considering doing the same at this point. So if you wouldn't mind taking a quick detour and sharing some of the creative ideas on if you've got open weights models

hosting in your own house, what are you going to go do? Yeah, absolutely. So first thing, I need to acknowledge the fact that I can do this also because of my flatmates. My flatmates are very keen to do these things, Otherwise, I wouldn't do this just for myself, probably. It's much better when I share this kind of, you know, like little games, I would say. Like when I was a kid, I was playing with, I don't know, the little raspberries, building little robots or something like this. Now, with all these technologies, I can write code a website in 15 minutes, right? I can do all these applications real quick. And when you back them with AI agent, what you can do is also allow them to take actions. So some projects that we're planning to do are, some of them are related to like house management, for example, reminders about the rubbish bins or reminders about the eating. Sometimes we leave the eating on overnight and we wake up at 4 a.m. sweating in our bed sheets.

That's a bit problematic. but also another interesting thing that we're planning to do but this is not just there yet would be enable live recording for all our evenings because as I said earlier we end up discussing about research and cool ideas over the evening we have a little whiteboard in the kitchen this is by choice if you want to diversify your time over the day but eventually we like it but one thing that we realize is that we have a lot of super interesting conversation, none of these get trapped. And sometimes we go back to them and we are like, but what did I say about this? There was an interesting bit that we should dig deeper into, but we forgot completely. So it's a live recording that keeps track of things and maybe ties into, I don't know, the latest research. Another project that my flatmate proposed this morning was related to the daily news about research papers. nowadays like x twitter it's it's it's completely blowing up like every every morning you wake up

there's five new papers out that are worth reading and it's very it's very difficult to keep the pace um so what we were thinking about is allowing agents to scrape all these new outcomes all these new pieces of research and going down to the kitchen in the morning making a coffee and get you know an audio play that is basically explaining look there's this thing interesting because you guys work on this particular topic. It's worth reading or something like that, like the daily news briefing about research. That would be one of the next projects. That's good. I appreciate that. Yeah, from my standpoint, the house management kind of things, the reminders, the recording that you know is private instead of going into one of these closed stores, love all those. And then I'm an animal person. We have a bunch of dogs, and I live in a place with a lot of wildlife around us. And so I'm starting to, with some of the cameras that we have around outside, to prompt us and say, there's a raccoon climbing on the tree outside the window, you know, things like that.

So little fun things. And I just appreciate you diving into that for a moment because so often we only focus on the work aspects of this. And these are capabilities that can affect your whole life in so many ways. Yeah, yeah. Great, great, great little rabbit hole. Thanks for going. Every AI expert seems to recommend a different tool. When I start a project, which one do I use? I'm Chris Benson, and this message is sponsored by Perplexity Computer. Computer breaks projects into tasks, automatically selects models, and coordinates agents, from research and analysis through finished presentations. I use computer to research the systems that enable autonomous uncrewed platforms to work together as a swarm toward a shared goal. Its research insights help enhance my own technical creativity. For a limited time only, our listeners can try Perplexity Computer for free. Head to pplx.ai slash practicalai.

That's pplx.ai slash practicalai to try computer today. Most AI tools are still answering questions while Perplexity Computer is completing full projects. So, Lorenzo, that was a good dive down into some of the personal aspects. As we come back in and get back to the work world, if you will, and you have folks out there listening, they've been learning about federated learning from you. They've been learning about Agentix and their integration. Can you talk a little bit about how people should start thinking about federated learning and Agentix to pull this together in different contexts? So they're going to be running some sort of business or organization out there. We don't necessarily know what it is, but do you have any way of framing kind of how to get started

and the way you think about problem solving so that you can get productive quickly? Do you have any guidance around that? Yeah, this is a very interesting question. I've recently got exposed much more to this kind of area because when I was doing only research for my PhD, we do have some interaction with industry, but it's not that deep. Now working with Flower Labs, there's a lot more going on and a lot more discussions and things to learn from. And one thing that stood out to me was that now these models, especially the most capable ones, those that can do things, are getting smaller and smaller, easier and easier to deploy, right? And the amount of usage that these models have is even bigger and bigger, right? So the scale of usage is increasing. The scale of the models is decreasing. The costs are decreasing as well, right? But one more thing that we suddenly realized is that in order to get these models better at doing something,

and doing something is what you decide, right? Like I decide what they better doing what right Because I use them or companies enterprises they decide what models are useful for because they use it Realize that this requires deeper analysis. It requires collecting data. It requires identifying failure modes. And this cannot be done very easily if you don't control all these trajectories that we discussed earlier about, right? Sure. Because that's the only way to really inspect how the model breaks or where the model can be improved on. So one thing we see pretty frequently nowadays is that people start deploying these models, they start choosing them for a specific use case, but then they have difficulties in setting up applications or improving them or building on top of these things.

but whenever they have control over the data and they can analyze what happened in the past and what are the things that could break or did break there are many ways to fix them and fixing them may require some additional training which is sometimes expensive other times it's just a matter of the application side maybe you didn't think very carefully about that particular step or that particular external tool that the model was using But the only way to know is by looking at what happened, like going back, looking at the trajectory and try to understand it properly. So this is why I think we will see an increasing effort, especially for big enterprises who are very cautious about their data, their internal flows, because it's their actual IP. sometimes it's not just your product it's about what you do to make your product work or what you do to make your product better we see a lot of these enterprises

looking into these trajectories and try to improve models by themselves without relying on external providers that often don't disclose the full traces or the full steps that the model took to get to a particular answer right and on the other side there's the interpretability kind of path right like sometimes we now we're trying to use models in very sensitive applications I've seen models doing surgery for real like commanding robots to do surgery and this was super cool to see but then I thought like do we know why they did that particular step or can we make sure that if they did that particular step, the model knew why this was the best choice. And it did evaluate all the potential things to do beforehand. Because there's plenty of sensitive applications where you would really like to have control over the motivations or the reasons

behind specific workflows. And for this, there's the entire interpretability kind of area or path that is getting more and more important and more and more interesting these days. And still, it requires... a lot of data. It requires a lot of analysis, a lot of deeper analysis, and much more control over the model compared to what you can get out of a standard subscription from any big company product. Right. You know, you raised some really interesting points I want to ask you about there, and that is, you talk about that, you know, models are getting more capable, but they're also getting both cheaper and easier to deploy as they get smaller. And we're also seeing more models out there, you know, to where a given application or a use case that one might have, instead of one model driving it, it may have multiple models. And they can be both cloud-based and they can be, you know, embodied in robotics or drones

or other things that we're talking about that affect the physical world. And so it's kind of getting complicated, you know, as in the architecture, both not just the computing architecture, but the physical architecture of how these relate. Any thoughts about, with agentics mixed in and the actions that that implies, any thoughts about how federated learning and agentics and all come together when we are talking about real world? And, you know, people are, to your point, they are going to go into hospitals, they are going to have surgeries, and there may be a human surgeon present, but it may be that the actual surgery is conducted by a robot that's being driven by a model with a level of precision that the human probably can't safely do, which touches close to home. I have a stepdaughter who is a surgeon, and I know her husband is involved in that. And so I'm very curious, like, how you think about how all this comes together.

I mean, as we're starting to wind up, you want to kind of lay out kind of where things are at and what you're thinking about it in terms of at least today for the moment, like where we're at now and what people can do. Yeah, so right now we know that we can collect these traces as I said, and these can be useful to improve applications or create new ones as well. Because whenever you put a model out of its comfort zone, so something that it's never tried before, it's going to make a lot of mistakes, and you can only correct them if you know where these mistakes have happened, right? So one thing where federated learning or any collaborative learning technology, because federated learning is one of them, could help, is in making sure that we can pull sufficient episodes, sufficient use cases, sufficient situations, well, not environments, but maybe actions in environments that would be useful to improve the broader capabilities of these models.

For example, in the surgeon kind of area, you can think about, okay, a surgeon does a lot of actions to perform a particular surgery technique, but everybody is different, right? Maybe you have one person that has particular features, another person has different features, and all the days, they're different. So it's never going to be the same at all times, right? and of course you cannot scale up the amount of trials that you do unless you have a very good way to simulate this world but we're not just there yet. So currently the only way to increase the amount of improvements like to increase the pace of improvement for this model is get more and more data and make sure that you can train on this data in order to improve the model. And one clear way to get more and more data is sourcing it from many different places at once. Many different hospitals or many different silos,

many different areas. And collaborative learning technologies, federated learning technologies can help a lot with that. And they can help right now. Like for the kind of collection pipelines that we have currently, for the current training methods that we have currently, these collaborative learning techniques can help out of the box. Fantastic. That gives me a lot to think about. As we come to a close here, I would like to finish by asking you to think a little bit creatively about the future. We like to finish up episodes with a little bit of insight into what your dreams are about, what you're thinking about the future. we often will ask it's kind of like the shower before you go into bed or you're laying down or you've had a glass of wine or whatever you do to just chill out and relax and as your mind flows where do you think things are going

what are you hoping to see and what would you like to be part of in the future and wax a little poetic where whether it happens or not just the way you say I'd love to get an idea of where you think things might go? Yeah, so my strong hope is that the work I am doing right now and the work I did in the past few years is going to serve as a massive enabler for people. As models are reduced in size, as time goes, as compute gets better, I hope that everybody will be able to run the same pipelines I've developed and I'm developing on their own laptop, on their own infrastructure, in their own houses to enable them to do whatever they want, like whatever they want, whatever they want to improve their house. As you were saying earlier, one can apply this to all the cameras to inspect the wildlife going around the house, as well as doing something very useful, but also for work or for your personal life

or for optimizing some of the processes that you feel they are very, very annoying. In most cases, the best innovations come from, that's my personal opinion, come from two factors. One is the constraints. So when you're under constraint, usually you develop best solutions to go around them or to work around them. And whenever you find something that is very annoying to you. Whenever I find something that is very annoying to me, I really want to get it done. Like this shouldn't be annoying anymore to me. What can we do to make it better? I like that. I like that a lot. And I like that perspective that's kind of holistic to life there. Yes, you're doing things for work and your job and things like that, but you're also enriching your life in that way. It's a great perspective. Lorenzo, thank you so much for coming on the show. I've really enjoyed the conversation. I learned a lot from you, and I hope that as you proceed with your research going forward that you'll come back on the show and share some of the things that you've learned in the future.

Totally. Thanks a lot for having me. It's been a pleasure. Thank you very much. Thank you. All right. That's our show for this week. If you haven't checked out our website, head to practicalai.fm and be sure to connect with us on LinkedIn, X, or Blue Sky. You'll see us posting insights related to the latest AI developments, and we would love for you to join the conversation. Thanks to our partner, Prediction Guard, for providing operational support for the show. Check them out at predictionguard.com. Also, thanks to Breakmaster Cylinder for the beats and to you for listening. That's all for now. But you'll hear from us again next week.

番組の概要欄(原文)

<p>How can AI models learn from private data without compromising privacy? Chris is joined by Lorenzo Sani, Research Scientist at Flower Labs and PhD researcher at Cambridge, to explore federated learning and privacy-preserving AI. They discuss how collaborative learning can expand access to private data for LLM training, how model trajectories can help improve agentic AI systems, and the benefits of open-weight models. The conversation also explores real-world applications of locally hosted AI agents, from healthcare and robotics to everyday automation (for a Halloween party).</p><p>Featuring: </p><ul><li>Lorenzo Sani – <a href="https://www.linkedin.com/in/spencer-mcintyre-b48987194/">LinkedIn</a></li><li>Chris Benson – <a href="https://chrisbenson.com/">Website</a>, <a href="https://www.linkedin.com/in/chrisbenson">LinkedIn</a>, <a href="https://bsky.app/profile/chrisbenson.bsky.social">Bluesky</a>, <a href="https://github.com/chrisbenson">GitHub</a>, <a href="https://x.com/chrisbenson">X</a></li></ul><p>Links:</p><ul><li><a href="https://flower.ai/models/endeavor">Endeavor model page</a></li><li><a href="https://flower.ai/blog/2026-11-03-introducing-endeavor-1.1">Introducing Endeavor 1.1</a></li></ul><p>Sponsors:</p><ul><li><a href="https://www.hostinger.com/in">Hostinger</a>: Create your website today. Go to hostinger.com/practical and use practical for 10 percent off now.</li><li><a href="https://www.perplexity.ai/gen/computer-lp/signin?_fallback_redirect=https%3A%2F%2Fwww.perplexity.ai%2Fgen%2Fcomputer-lp%2Fsignin%3Fpplx_account%3D49b12d57-abd5-43cd-8292-23ac5793257e&amp;cl=p0yH9EGTSaSoYvCA&amp;dub_id=p0yH9EGTSaSoYvCA&amp;pcn=PRACTICAL&amp;pcrn=EvergreenMultiModel&amp;pplx_account=49b12d57-abd5-43cd-8292-23ac5793257e&amp;pscn=PracticalAi&amp;referrer=singular_click_id%3D8d3a8185-3295-4fa0-a0f2-1f2503087d8c&amp;sl_id=j9oq&amp;utm_campaign=PRACTICAL&amp;utm_content=EvergreenMultiModel&amp;utm_medium=PracticalAi&amp;utm_source=Podcast&amp;wpcn=PRACTICAL&amp;wpcrn=EvergreenMultiModel&amp;wpscn=PracticalAi&amp;wpsrc=Podcast">Perplexity AI</a>: <em>"</em>Start your free trial of Perplexity Computer today at <a href="https://www.perplexity.ai/gen/computer-lp/signin?_fallback_redirect=https%3A%2F%2Fwww.perplexity.ai%2Fgen%2Fcomputer-lp%2Fsignin%3Fpplx_account%3D49b12d57-abd5-43cd-8292-23ac5793257e&amp;cl=zN8r91RbQPOPm2s7&amp;dub_id=zN8r91RbQPOPm2s7&amp;pcn=PRACTICAL&amp;pcrn=EvergreenMultiModel&amp;pplx_account=49b12d57-abd5-43cd-8292-23ac5793257e&amp;pscn=PracticalAi&amp;referrer=singular_click_id%3D5c506b32-4d62-4f5b-9000-50a616249f55&amp;sl_id=j9oq&amp;utm_campaign=PRACTICAL&amp;utm_content=EvergreenMultiModel&amp;utm_medium=PracticalAi&amp;utm_source=Podcast&amp;wpcn=PRACTICAL&amp;wpcrn=EvergreenMultiModel&amp;wpscn=PracticalAi&amp;wpsrc=Podcast">pplx.ai/practical</a> and experience the next phase of AI.</li></ul><p>Resources and Events:</p><ul><li>Register for <a href="https://practicalai.fm/webinars">upcoming webinars here</a>!</li><li>Prior <a href="https://www.youtube.com/playlist?list=PLRpRdFmBfdF6boDgAD3nNaLm8Yx4KN2Vt">Webinars from our partner Prediction Guard</a></li><li><a href="https://midwestaisummit.com/">Midwest AI Summit 2026</a></li></ul><p>Chris’s new book <strong><em>The Art of Swarming</em></strong> will be published soon, written to be the seminal foundational book for the fledgling swarming industry, defining the principles and architecture that enable autonomous agentic UxS swarms with emergent distributed embodied intelligence.  You can find out more at his <a href="https://chrisbenson.com/">website</a>:  <a href="https://chrisbenson.com">https://chrisbenson.com</a></p>

出典・この記事について

番組
Practical AI(Daniel Whitenack and Chris Benson)
元の回
Implementing Federated Learning to enhance Agentic AI
配信日
要約作成日
公式サイト
practicalai.show

この要約・解説記事は、元の音声を文字起こしした内容をもとに AI(Claude)が日本語で作成したものです。 固有名詞や数値に誤りを含む場合があるため、正確な内容は元の音声でご確認ください。制作方法について

X でシェアSpotify で聴くApple Podcasts で聴く

関連エピソード