Hugging Face's logo

Spaces:
sail
/
pipeline-parallelism-with-controllable-memory
Running

App Files Community
nvmdava commited on
Commit
a9bdfe4
·
verified ·
1 Parent(s): c9f689e

Update description3.md

Browse files
Files changed (1) hide show
  1. description3.md +12 -6
description3.md CHANGED
@@ -1,8 +1,14 @@
1
  We showcase the building block of each alternative schedules below.
2
 
3
- <img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/TXf74JGHaqanCcMm_jPbw.jpeg" height="100px"/>
4
- <center>1F1B-V</center>
5
- <img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/TCCgzQEwjLDO3_12OUzmN.jpeg" height="100px"/>
6
- <center>Zero Bubble schedule with 2/3 1F1B memory</center>
7
- <img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/AwXeE4e0HO20u_YJV23AN.jpeg" height="100px"/>
8
- <center>Variation of Interleaved 1F1B schedule</center>
 
 
 
 
 
 
 
1
  We showcase the building block of each alternative schedules below.
2
 
3
+ ### 1F1B-V:
4
+
5
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/TXf74JGHaqanCcMm_jPbw.jpeg" width="690px"/>
6
+
7
+ ### Zero Bubble schedule with 2/3 1F1B memory:
8
+
9
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/TCCgzQEwjLDO3_12OUzmN.jpeg" width="480px"/>
10
+
11
+ ### Variation of Interleaved 1F1B schedule:
12
+
13
+ <img src="https://cdn-uploads.huggingface.co/production/uploads/646968e05d7015663950e95b/AwXeE4e0HO20u_YJV23AN.jpeg" width="719px"/>
14
+