Skip to content

Commit 55c663f

Browse files
authored
Update imports (#1155)
Update main.py
1 parent 7b7c708 commit 55c663f

File tree

1 file changed

+4
-2
lines changed
  • distributed/minGPT-ddp/mingpt

1 file changed

+4
-2
lines changed

distributed/minGPT-ddp/mingpt/main.py

Lines changed: 4 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -1,10 +1,12 @@
1+
import torch
2+
from torch.utils.data import random_split
3+
from torch.distributed import init_process_group, destroy_process_group
14
from model import GPT, GPTConfig, OptimizerConfig, create_optimizer
25
from trainer import Trainer, TrainerConfig
36
from char_dataset import CharDataset, DataConfig
4-
from torch.utils.data import random_split
57
from omegaconf import DictConfig
68
import hydra
7-
from torch.distributed import init_process_group, destroy_process_group
9+
810

911
def ddp_setup():
1012
init_process_group(backend="nccl")

0 commit comments

Comments
 (0)