Victarry commited on
Commit
a885118
·
1 Parent(s): 8402d37

Add references

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -108,6 +108,12 @@ PP-Emulation/
108
  └── README.md # This file
109
  ```
110
 
 
 
 
 
 
 
111
  ## License
112
 
113
  This project is licensed under the MIT License - see the LICENSE file for details.
 
108
  └── README.md # This file
109
  ```
110
 
111
+ ## Refences
112
+ 1. _PipeDream: Fast and Efficient Pipeline Parallel DNN Training_. [arxiv](https://arxiv.org/abs/1806.03377)
113
+ 2. _Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM_. [arxiv](https://arxiv.org/abs/2104.04473)
114
+ 3. _Zero Bubble Pipeline Parallelism_ [arxiv](https://arxiv.org/abs/2401.10241)
115
+ 4. 基于1F1B的MoE A2A通信计算Overlap [blog](https://zhuanlan.zhihu.com/p/28463368206)
116
+
117
  ## License
118
 
119
  This project is licensed under the MIT License - see the LICENSE file for details.