Skip to content

Commit 38c0aa5

Browse files
author
Svetlana Karslioglu
authored
Update FSDP advanced training (pytorch#1969)
* Update FSDP advanced training - Include in index.rst - Include in what's new - Limit width to 80 chars
1 parent 0918023 commit 38c0aa5

File tree

2 files changed

+162
-51
lines changed

2 files changed

+162
-51
lines changed

index.rst

Lines changed: 10 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -5,6 +5,7 @@ What's new in PyTorch tutorials?
55

66
* `Introduction to TorchRec <https://pytorch.org/tutorials/intermediate/torchrec_tutorial.html?utm_source=whats_new_tutorials&utm_medium=torchrec>`__
77
* `Getting Started with Fully Sharded Data Parallel (FSDP) <https://pytorch.org/tutorials/intermediate/FSDP_tutorial.html?utm_source=whats_new_tutorials&utm_medium=FSDP>`__
8+
* `Advanced model training with Fully Sharded Data Parallel (FSDP) <https://pytorch.org/tutorials/intermediate/FSDP_adavnced_tutorial.html?utm_source=whats_new_tutorials&utm_medium=FSDP_advanced>`__
89
* `Grokking PyTorch Intel CPU Performance from First Principles <https://pytorch.org/tutorials/intermediate/torchserve_with_ipex?utm_source=whats_new_tutorials&utm_medium=torchserve_ipex>`__
910
* `Customize Process Group Backends Using Cpp Extensions <https://pytorch.org/tutorials/intermediate/process_group_cpp_extension_tutorial.html?utm_source=whats_new_tutorials&utm_medium=cpp_ext>`__
1011
* `Forward-mode Automatic Differentiation <https://pytorch.org/tutorials/intermediate/forward_ad_usage.html?utm_source=whats_new_tutorials&utm_medium=forward_ad>`__ (added functorch API capabilities)
@@ -579,10 +580,17 @@ What's new in PyTorch tutorials?
579580
.. customcarditem::
580581
:header: Getting Started with Fully Sharded Data Parallel(FSDP)
581582
:card_description: Learn how to train models with Fully Sharded Data Parallel package.
582-
:image: _static/img/thumbnails/cropped/Getting Started with FSDP.png
583+
:image: _static/img/thumbnails/cropped/Getting-Started-with-FSDP.png
583584
:link: intermediate/FSDP_tutorial.html
584585
:tags: Parallel-and-Distributed-Training
585586

587+
.. customcarditem::
588+
:header: Advanced Model Training with Fully Sharded Data Parallel (FSDP)
589+
:card_description: Explore advanced model training with Fully Sharded Data Parallel package.
590+
:image: _static/img/thumbnails/cropped/Getting-Started-with-FSDP.png
591+
:link: intermediate/FSDP_adavnced_tutorial.html
592+
:tags: Parallel-and-Distributed-Training
593+
586594
.. Mobile
587595
588596
.. customcarditem::
@@ -857,6 +865,7 @@ Additional Resources
857865
intermediate/ddp_tutorial
858866
intermediate/dist_tuto
859867
intermediate/FSDP_tutorial
868+
intermediate/FSDP_adavnced_tutorial
860869
intermediate/process_group_cpp_extension_tutorial
861870
intermediate/rpc_tutorial
862871
intermediate/rpc_param_server_tutorial

0 commit comments

Comments
 (0)