Hi Alexander,

All of the workers contain a copy of the global network parameters, and use it to generate gradients, which are then sent to the global network to update the parameters. From there the new global network is copied over to the worker again.

PhD. Interests include Deep (Reinforcement) Learning, Computational Neuroscience, and Phenomenology.

Get the Medium app

A button that says 'Download on the App Store', and if clicked it will lead you to the iOS App store
A button that says 'Get it on, Google Play', and if clicked it will lead you to the Google Play store