Spaces:
Running
Running
Add references
Browse files
README.md
CHANGED
@@ -108,6 +108,12 @@ PP-Emulation/
|
|
108 |
└── README.md # This file
|
109 |
```
|
110 |
|
|
|
|
|
|
|
|
|
|
|
|
|
111 |
## License
|
112 |
|
113 |
This project is licensed under the MIT License - see the LICENSE file for details.
|
|
|
108 |
└── README.md # This file
|
109 |
```
|
110 |
|
111 |
+
## Refences
|
112 |
+
1. _PipeDream: Fast and Efficient Pipeline Parallel DNN Training_. [arxiv](https://arxiv.org/abs/1806.03377)
|
113 |
+
2. _Efficient Large-Scale Language Model Training on GPU Clusters Using Megatron-LM_. [arxiv](https://arxiv.org/abs/2104.04473)
|
114 |
+
3. _Zero Bubble Pipeline Parallelism_ [arxiv](https://arxiv.org/abs/2401.10241)
|
115 |
+
4. 基于1F1B的MoE A2A通信计算Overlap [blog](https://zhuanlan.zhihu.com/p/28463368206)
|
116 |
+
|
117 |
## License
|
118 |
|
119 |
This project is licensed under the MIT License - see the LICENSE file for details.
|