You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
<spanclass="sig-prename descclassname"><spanclass="pre">torch.distributed.GradBucket.</span></span><spanclass="sig-name descname"><spanclass="pre">gradients</span></span><spanclass="sig-paren">(</span><emclass="sig-param"><spanclass="n"><spanclass="pre">self</span></span><spanclass="p"><spanclass="pre">:</span></span><spanclass="w"></span><spanclass="n"><aclass="reference internal" href="#torch.distributed.GradBucket" title="torch._C._distributed_c10d.GradBucket"><spanclass="pre">torch._C._distributed_c10d.GradBucket</span></a></span></em><spanclass="sig-paren">)</span><spanclass="sig-return"><spanclass="sig-return-icon">→</span><spanclass="sig-return-typehint"><spanclass="pre">List</span><spanclass="p"><spanclass="pre">[</span></span><aclass="reference internal" href="tensors.html#torch.Tensor" title="torch.Tensor"><spanclass="pre">torch.Tensor</span></a><spanclass="p"><spanclass="pre">]</span></span></span></span><aclass="headerlink" href="#torch.distributed.GradBucket.gradients" title="Permalink to this definition">¶</a></dt>
530
+
<spanclass="sig-prename descclassname"><spanclass="pre">torch.distributed.GradBucket.</span></span><spanclass="sig-name descname"><spanclass="pre">gradients</span></span><spanclass="sig-paren">(</span><emclass="sig-param"><spanclass="n"><spanclass="pre">self</span></span><spanclass="p"><spanclass="pre">:</span></span><spanclass="w"></span><spanclass="n"><aclass="reference internal" href="#torch.distributed.GradBucket" title="torch._C._distributed_c10d.GradBucket"><spanclass="pre">torch._C._distributed_c10d.GradBucket</span></a></span></em><spanclass="sig-paren">)</span><spanclass="sig-return"><spanclass="sig-return-icon">→</span><spanclass="sig-return-typehint"><aclass="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.12)"><spanclass="pre">list</span></a><spanclass="p"><spanclass="pre">[</span></span><aclass="reference internal" href="tensors.html#torch.Tensor" title="torch.Tensor"><spanclass="pre">torch.Tensor</span></a><spanclass="p"><spanclass="pre">]</span></span></span></span><aclass="headerlink" href="#torch.distributed.GradBucket.gradients" title="Permalink to this definition">¶</a></dt>
531
531
<dd><dlclass="field-list simple">
532
532
<dtclass="field-odd">Returns</dt>
533
533
<ddclass="field-odd"><p>A list of <codeclass="docutils literal notranslate"><spanclass="pre">torch.Tensor</span></code>. Each tensor in the list corresponds to a gradient.</p>
@@ -554,7 +554,7 @@ <h2>What Does a Communication Hook Operate On?<a class="headerlink" href="#what-
<spanclass="sig-prename descclassname"><spanclass="pre">torch.distributed.GradBucket.</span></span><spanclass="sig-name descname"><spanclass="pre">parameters</span></span><spanclass="sig-paren">(</span><emclass="sig-param"><spanclass="n"><spanclass="pre">self</span></span><spanclass="p"><spanclass="pre">:</span></span><spanclass="w"></span><spanclass="n"><aclass="reference internal" href="#torch.distributed.GradBucket" title="torch._C._distributed_c10d.GradBucket"><spanclass="pre">torch._C._distributed_c10d.GradBucket</span></a></span></em><spanclass="sig-paren">)</span><spanclass="sig-return"><spanclass="sig-return-icon">→</span><spanclass="sig-return-typehint"><spanclass="pre">List</span><spanclass="p"><spanclass="pre">[</span></span><aclass="reference internal" href="tensors.html#torch.Tensor" title="torch.Tensor"><spanclass="pre">torch.Tensor</span></a><spanclass="p"><spanclass="pre">]</span></span></span></span><aclass="headerlink" href="#torch.distributed.GradBucket.parameters" title="Permalink to this definition">¶</a></dt>
557
+
<spanclass="sig-prename descclassname"><spanclass="pre">torch.distributed.GradBucket.</span></span><spanclass="sig-name descname"><spanclass="pre">parameters</span></span><spanclass="sig-paren">(</span><emclass="sig-param"><spanclass="n"><spanclass="pre">self</span></span><spanclass="p"><spanclass="pre">:</span></span><spanclass="w"></span><spanclass="n"><aclass="reference internal" href="#torch.distributed.GradBucket" title="torch._C._distributed_c10d.GradBucket"><spanclass="pre">torch._C._distributed_c10d.GradBucket</span></a></span></em><spanclass="sig-paren">)</span><spanclass="sig-return"><spanclass="sig-return-icon">→</span><spanclass="sig-return-typehint"><aclass="reference external" href="https://docs.python.org/3/library/stdtypes.html#list" title="(in Python v3.12)"><spanclass="pre">list</span></a><spanclass="p"><spanclass="pre">[</span></span><aclass="reference internal" href="tensors.html#torch.Tensor" title="torch.Tensor"><spanclass="pre">torch.Tensor</span></a><spanclass="p"><spanclass="pre">]</span></span></span></span><aclass="headerlink" href="#torch.distributed.GradBucket.parameters" title="Permalink to this definition">¶</a></dt>
558
558
<dd><dlclass="field-list simple">
559
559
<dtclass="field-odd">Returns</dt>
560
560
<ddclass="field-odd"><p>A list of <codeclass="docutils literal notranslate"><spanclass="pre">torch.Tensor</span></code>. Each tensor in the list corresponds to a model
<spanclass="sig-prename descclassname"><spanclass="pre">torch.distributed.Store.</span></span><spanclass="sig-name descname"><spanclass="pre">wait</span></span><spanclass="sig-paren">(</span><emclass="sig-param"><spanclass="o"><spanclass="pre">*</span></span><spanclass="n"><spanclass="pre">args</span></span></em>, <emclass="sig-param"><spanclass="o"><spanclass="pre">**</span></span><spanclass="n"><spanclass="pre">kwargs</span></span></em><spanclass="sig-paren">)</span><aclass="headerlink" href="#torch.distributed.Store.wait" title="Permalink to this definition">¶</a></dt>
<p>Waits for each key in <codeclass="docutils literal notranslate"><spanclass="pre">keys</span></code> to be added to the store. If not all keys are
1354
1354
set before the <codeclass="docutils literal notranslate"><spanclass="pre">timeout</span></code> (set during store initialization), then <codeclass="docutils literal notranslate"><spanclass="pre">wait</span></code>
<p>Waits for each key in <codeclass="docutils literal notranslate"><spanclass="pre">keys</span></code> to be added to the store, and throws an exception
1376
1376
if the keys have not been set by the supplied <codeclass="docutils literal notranslate"><spanclass="pre">timeout</span></code>.</p>
0 commit comments