However, during the forward pass, each replica needs all the parameters.
Edit: Sorry, I misunderstood.
· Sign up or log in to comment