aNet.ai
Machine Learning/Learning path
0day streak0XP · Lv 1
← 17. Distributed ML
Lesson 7 of 7 9 min · 125 words

Distributed GANs (DGANs)

Training generators and discriminators across distributed data sources.

A distributed GAN (DGAN) trains a generative adversarial network when the real data is spread across several sites that can't share it — hospitals with patient scans, for example.

Common designs: each site keeps a local discriminator that sees its private data, while a central generator learns from all the discriminators' feedback (as in MD-GAN). Or the generator and discriminator are both trained federated-style, with parameters averaged across sites (FedGAN).

The result is a generator that captures the combined data distribution, which can then produce synthetic data for sharing, augmentation or analysis — without any site revealing its raw records.

Formula to remember

Federated averaging

Global model = data-weighted average of client models.

Quick check · +5 XP

Splitting one large network across several GPUs is…

Practice this topic
Saved in this browser as you type.
aNet.ai · Introduction to Machine Learning · NewUU course outlineProgress saved in this browser