aNet.ai
Machine Learning/Learning path
0day streak0XP · Lv 1
← 17. Distributed ML
Lesson 4 of 7 9 min · 134 words

Federated learning

Training on devices; only model updates leave them.

Federated learning (FL) trains a shared model across many clients — phones, hospitals, banks — without collecting their raw data. Data stays where it was created; only model updates travel.

A typical round:

  • The server sends the current global model to a sample of clients.
  • Each client trains locally on its own data for a few epochs.
  • Clients send back their updated weights (or weight changes).
  • The server aggregates them into a new global model.

It enables learning from data that is private, regulated or too costly to move. Real deployments include next-word prediction on phone keyboards and collaborative medical-imaging models across hospitals.

Formula to remember

Data-parallel gradient

Each worker computes a gradient on its shard; results are averaged.

Quick check · +5 XP

A drawback of asynchronous data-parallel training is…

Practice this topic
Saved in this browser as you type.
aNet.ai · Introduction to Machine Learning · NewUU course outlineProgress saved in this browser