Commit e860a2c
1 parent 44d04b5 commit e860a2c
File tree
5 files changed
+92
-18
lines changed- torchrec/distributed
- sharding
5 files changed
+92
-18
lines changedLines changed: 13 additions & 1 deletion
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
822 | 822 |
| |
823 | 823 |
| |
824 | 824 |
| |
| 825 | + | |
825 | 826 |
| |
826 | 827 |
| |
827 | 828 |
| |
828 | 829 |
| |
829 | 830 |
| |
830 | 831 |
| |
| 832 | + | |
831 | 833 |
| |
832 | 834 |
| |
833 | 835 |
| |
834 | 836 |
| |
835 | 837 |
| |
836 | 838 |
| |
837 | 839 |
| |
| 840 | + | |
838 | 841 |
| |
839 | 842 |
| |
840 | 843 |
| |
841 | 844 |
| |
842 | 845 |
| |
843 |
| - | |
| 846 | + | |
| 847 | + | |
| 848 | + | |
844 | 849 |
| |
845 | 850 |
| |
846 | 851 |
| |
| |||
1030 | 1035 |
| |
1031 | 1036 |
| |
1032 | 1037 |
| |
| 1038 | + | |
1033 | 1039 |
| |
1034 | 1040 |
| |
1035 | 1041 |
| |
| |||
1047 | 1053 |
| |
1048 | 1054 |
| |
1049 | 1055 |
| |
| 1056 | + | |
| 1057 | + | |
| 1058 | + | |
| 1059 | + | |
| 1060 | + | |
1050 | 1061 |
| |
1051 | 1062 |
| |
1052 | 1063 |
| |
| |||
1055 | 1066 |
| |
1056 | 1067 |
| |
1057 | 1068 |
| |
| 1069 | + | |
1058 | 1070 |
| |
1059 | 1071 |
| |
1060 | 1072 |
| |
|
Lines changed: 23 additions & 5 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
113 | 113 |
| |
114 | 114 |
| |
115 | 115 |
| |
116 |
| - | |
117 |
| - | |
118 |
| - | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
| 122 | + | |
| 123 | + | |
| 124 | + | |
| 125 | + | |
| 126 | + | |
| 127 | + | |
| 128 | + | |
| 129 | + | |
| 130 | + | |
| 131 | + | |
| 132 | + | |
| 133 | + | |
| 134 | + | |
| 135 | + | |
| 136 | + | |
119 | 137 |
| |
120 | 138 |
| |
121 | 139 |
| |
| |||
319 | 337 |
| |
320 | 338 |
| |
321 | 339 |
| |
322 |
| - | |
| 340 | + | |
323 | 341 |
| |
324 | 342 |
| |
325 | 343 |
| |
| |||
335 | 353 |
| |
336 | 354 |
| |
337 | 355 |
| |
338 |
| - | |
| 356 | + | |
339 | 357 |
| |
340 | 358 |
| |
341 | 359 |
| |
|
Lines changed: 4 additions & 1 deletion
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
232 | 232 |
| |
233 | 233 |
| |
234 | 234 |
| |
| 235 | + | |
235 | 236 |
| |
236 | 237 |
| |
237 | 238 |
| |
| |||
253 | 254 |
| |
254 | 255 |
| |
255 | 256 |
| |
256 |
| - | |
| 257 | + | |
| 258 | + | |
| 259 | + | |
257 | 260 |
| |
258 | 261 |
| |
259 | 262 |
| |
|
Lines changed: 51 additions & 11 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
15 | 15 |
| |
16 | 16 |
| |
17 | 17 |
| |
| 18 | + | |
| 19 | + | |
18 | 20 |
| |
19 | 21 |
| |
20 | 22 |
| |
| |||
68 | 70 |
| |
69 | 71 |
| |
70 | 72 |
| |
71 |
| - | |
72 |
| - | |
73 |
| - | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
74 | 95 |
| |
75 | 96 |
| |
76 | 97 |
| |
77 | 98 |
| |
78 |
| - | |
| 99 | + | |
79 | 100 |
| |
80 | 101 |
| |
81 | 102 |
| |
| |||
86 | 107 |
| |
87 | 108 |
| |
88 | 109 |
| |
| 110 | + | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
89 | 117 |
| |
90 | 118 |
| |
91 | 119 |
| |
| |||
103 | 131 |
| |
104 | 132 |
| |
105 | 133 |
| |
| 134 | + | |
| 135 | + | |
| 136 | + | |
106 | 137 |
| |
107 | 138 |
| |
108 | 139 |
| |
109 | 140 |
| |
110 | 141 |
| |
111 | 142 |
| |
112 |
| - | |
| 143 | + | |
| 144 | + | |
| 145 | + | |
| 146 | + | |
113 | 147 |
| |
114 | 148 |
| |
115 | 149 |
| |
| |||
148 | 182 |
| |
149 | 183 |
| |
150 | 184 |
| |
151 |
| - | |
| 185 | + | |
152 | 186 |
| |
153 | 187 |
| |
154 | 188 |
| |
155 | 189 |
| |
156 |
| - | |
| 190 | + | |
157 | 191 |
| |
158 | 192 |
| |
159 | 193 |
| |
| |||
167 | 201 |
| |
168 | 202 |
| |
169 | 203 |
| |
170 |
| - | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
| 207 | + | |
| 208 | + | |
171 | 209 |
| |
172 | 210 |
| |
173 | 211 |
| |
| |||
250 | 288 |
| |
251 | 289 |
| |
252 | 290 |
| |
253 |
| - | |
| 291 | + | |
254 | 292 |
| |
255 | 293 |
| |
256 | 294 |
| |
| |||
329 | 367 |
| |
330 | 368 |
| |
331 | 369 |
| |
332 |
| - | |
| 370 | + | |
| 371 | + | |
| 372 | + | |
333 | 373 |
| |
334 | 374 |
| |
335 | 375 |
| |
| |||
552 | 592 |
| |
553 | 593 |
| |
554 | 594 |
| |
555 |
| - | |
| 595 | + | |
556 | 596 |
| |
557 | 597 |
| |
558 | 598 |
| |
|
Lines changed: 1 addition & 0 deletions
Original file line number | Diff line number | Diff line change | |
---|---|---|---|
| |||
752 | 752 |
| |
753 | 753 |
| |
754 | 754 |
| |
| 755 | + | |
755 | 756 |
| |
756 | 757 |
| |
757 | 758 |
| |
|
0 commit comments