Lesson 4 of 7 9 min · 134 words
Federated learning
Training on devices; only model updates leave them.
Federated learning (FL) trains a shared model across many clients — phones, hospitals, banks — without collecting their raw data. Data stays where it was created; only model updates travel.
A typical round:
- The server sends the current global model to a sample of clients.
- Each client trains locally on its own data for a few epochs.
- Clients send back their updated weights (or weight changes).
- The server aggregates them into a new global model.
It enables learning from data that is private, regulated or too costly to move. Real deployments include next-word prediction on phone keyboards and collaborative medical-imaging models across hospitals.
Formula to remember
Data-parallel gradient
Each worker computes a gradient on its shard; results are averaged.
Quick check · +5 XP