Typo on ZeRO-1

#112
by yzlnew - opened

However, during the forward pass, each replica needs all the parameters.

Edit: Sorry, I misunderstood.

yzlnew changed discussion status to closed

Sign up or log in to comment