Skip to content

Commit 127f54c

Browse files
committed
feat(BeitV2): modify the way of weight init
1 parent a7f99b7 commit 127f54c

File tree

2 files changed

+4
-4
lines changed

2 files changed

+4
-4
lines changed

ppcls/arch/backbone/model_zoo/modeling_pretrain.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -358,7 +358,8 @@ def beit_base_patch16_224_8k_vocab_cls_pt(pretrained=False, pretrained_weight=No
358358
model = VisionTransformerForMaskedImageModelingCLS(
359359
patch_size=16, embed_dim=768, depth=12, num_heads=12, mlp_ratio=4, qkv_bias=True,
360360
norm_layer="nn.LayerNorm", vocab_size=vocab_size, **kwargs)
361-
weight = paddle.load(pretrained_weight)
362-
model.set_dict(weight)
361+
if pretrained:
362+
weight = paddle.load(pretrained_weight)
363+
model.set_dict(weight)
363364
model.default_cfg = _cfg()
364365
return model

ppcls/configs/ImageNet/BeitV2/BeitV2_base_patch16_224_pt.yaml

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -49,8 +49,7 @@ Arch:
4949
code_dim: 32
5050
- Student:
5151
name: beit_base_patch16_224_8k_vocab_cls_pt
52-
pretrained: True
53-
pretrained_weight: ./dataset/pretrain_model.pdparams
52+
pretrained: False
5453
drop_path_rate: 0.1
5554
use_shared_rel_pos_bias: True
5655
use_abs_pos_emb: False

0 commit comments

Comments
 (0)